-- Logs begin at Wed 2022-06-22 05:04:26 UTC, end at Wed 2022-06-22 06:30:15 UTC. -- Jun 22 05:51:50.715670 dv-cinder-836996-37-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 05:51:50.722912 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 05:51:50 2022] *** Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: nodename: dv-cinder-836996-37-iscsi Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: machine: x86_64 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: clock source: unix Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: pcre jit disabled Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: detected number of CPU cores: 4 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: current working directory: / Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: detected binary path: /usr/bin/uwsgi-core Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: your processes number limit is 47680 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: your memory page size is 4096 bytes Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: detected max file descriptor number: 2048 Jun 22 05:51:50.726491 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: lock engine: pthread robust mutexes Jun 22 05:51:50.729080 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: thunder lock: enabled Jun 22 05:51:50.729080 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 05:51:50.729080 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 05:51:50.769950 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: Python main interpreter initialized at 0x55c0e54fd9c0 Jun 22 05:51:50.769950 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: python threads support enabled Jun 22 05:51:50.769950 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: your server socket listen backlog is limited to 100 connections Jun 22 05:51:50.769950 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: your mercy for graceful operations on workers is 90 seconds Jun 22 05:51:50.770302 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 05:51:50.770378 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: *** Operational MODE: preforking *** Jun 22 05:51:50.770620 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: *** uWSGI is running in multiple interpreter mode *** Jun 22 05:51:50.770620 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: spawned uWSGI master process (pid: 79988) Jun 22 05:51:50.770824 dv-cinder-836996-37-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 05:51:50.772484 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: spawned uWSGI worker 1 (pid: 79994, cores: 1) Jun 22 05:51:50.772484 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: spawned uWSGI worker 2 (pid: 79995, cores: 1) Jun 22 05:51:50.772484 dv-cinder-836996-37-iscsi devstack@keystone.service[79988]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 05:51:56.200593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 05:51:56.200593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: from cryptography.utils import int_from_bytes Jun 22 05:51:56.201414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 05:51:56.201414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: from cryptography.utils import int_from_bytes Jun 22 05:51:56.204552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 05:51:56.204552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: from cryptography.utils import int_from_bytes Jun 22 05:51:56.205028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 05:51:56.205028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: from cryptography.utils import int_from_bytes Jun 22 05:51:56.250432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 05:51:56.250627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 05:51:56.250819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] command line args: [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 05:51:56.251094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 05:51:56.251273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ================================================================================ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 05:51:56.251546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] admin_token = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.251794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_dir = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.251980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.252145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 05:51:56.252226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] config_source = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.252323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] debug = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.252412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 05:51:56.252518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.252761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] command line args: [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 05:51:56.252761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 05:51:56.252871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.252941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ================================================================================ {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 05:51:56.253074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] admin_token = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] config_dir = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] config_source = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_config_append = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.253987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] debug = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_dir = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.254980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.255942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_config_append = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_dir = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_file = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.256956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.257135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.257311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.257492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.257670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.257851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.258923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.259647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] publish_errors = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.260911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] standard_threads = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] publish_errors = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.261989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_journal = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_json = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.262901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_stderr = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] use_syslog = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] standard_threads = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.263761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.263874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.263988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.264113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.264230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.264344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.264464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] use_journal = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.264464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] use_json = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.264678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.264803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] use_stderr = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.264924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] use_syslog = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.265214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 05:51:56.265451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.265928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.266996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.267977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268880 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.268994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.269924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.270994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.271977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.272903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.273818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.274923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.275977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.276987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.277943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.278895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.279908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.280962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.281904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.282970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.283950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.284940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.285062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.285177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.285292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.285407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.286948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.287956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.288902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.external = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.289981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.password = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] auth.token = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.290967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.external = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.291928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.password = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] auth.token = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.292995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.293839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.294900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.295895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.296983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.297942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.298886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.299965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.300994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.301110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.301236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.301422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.302953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.303924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.304972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.305890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.306955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.307935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.308990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.309921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310862 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.310978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311709 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.311939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.312887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.313934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.314999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.315982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.316926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.317894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.318829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.319996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.320926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.321981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.322912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.323987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324103 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.324944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] role.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] role.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.325928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.326969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.327930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.328980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.329902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.330966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.331958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.332086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.332204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.332319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.332435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.332550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.333957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.334910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.335978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.336915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.337962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.338895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.connection = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.339929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.340865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.341806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.341806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.341806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 05:51:56.341806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 05:51:56.364607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.364837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.365069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.366801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.367037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.367267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.373474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.375752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.401484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.401710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.406569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.406802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.543054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.543265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.591343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.591595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.592106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.592342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.654691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.654914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.655874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.656012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.656225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.680833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.681796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.682139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.682279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.682279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.682452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.682538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.693630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.693861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.706922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79994) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.707784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 05:51:56.725446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.725654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 05:51:56.725855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.725983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.726064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 05:51:56.726184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 05:51:56.726380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.726460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.726577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 05:51:56.726684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.726838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.726919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.727090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.727170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.727343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.727619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.737845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.738884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.739164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.747066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.747385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.750322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.750598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.750715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.750874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.750993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.751969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.752888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.753016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.753154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.753412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.780074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.780534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.781657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.781931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.782137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.782411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.787151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.787556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.787638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.787834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.788029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.788305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.795018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.795257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.795488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.795786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.799696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.799975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.800212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.800292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.800494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.800584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.800760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.800839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.801863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.802127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.821134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.821287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.821408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.821560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.825974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.826133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.829641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.829735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.829963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.830113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.835469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.835724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.839307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.839526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.842961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.843984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.844101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.844253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.844372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.844528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.863235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.863326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.863529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.863613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.863823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.863920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.864090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.864171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.871839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.871920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.873500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.873583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.873773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.873861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.876946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.877029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.877221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.877302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.877489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.877569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.877757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.877845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.878029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.878109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.891570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.891696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.891843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.891976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.892121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.892256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.892393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.892531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.893877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.894036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.894170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.894323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.894464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.894613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.912572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.912853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.915843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.916126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.919069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.919370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.920800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.921117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.922398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.922672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.922753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.922946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.923027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.923253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.930216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.930628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.931824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.932119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.934999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.935273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.935356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.935580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.935665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.935934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.936038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.936219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.945466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.945746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.945827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.946025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.946119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.946349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.953791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79994) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.954066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 05:51:56.954338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.954962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.955904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.956950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.957129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.957210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.957398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.957536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79994) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.958207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 05:51:56.995384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0e54fd9c0 pid: 79994 (default app) Jun 22 05:51:56.997515 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c0e54fd9c0 pid: 79995 (default app) Jun 22 05:51:56.998702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b227-4d49-469d-a72c-c7b4cd5948ba None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:51:56.998993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b227-4d49-469d-a72c-c7b4cd5948ba None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:51:56.999271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937b227-4d49-469d-a72c-c7b4cd5948ba None None] PATH_INFO: `/v3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:51:57.003468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Jun 22 05:51:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:04.703960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:04.704524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:04.704524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:04.709383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:04.715188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:04.715696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:04.715815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:04.784305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: INFO dbcounter [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] Registered counter for database keystone Jun 22 05:52:04.805578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG oslo_db.sqlalchemy.engines [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 05:52:04.811733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writer thread running {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 05:52:04.990072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG passlib.handlers.bcrypt [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79994) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 05:52:04.990410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG passlib.handlers.bcrypt [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79994) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 05:52:05.045851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:05.047851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:05.171513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 05:52:05.331433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:05.404014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: INFO dbcounter [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] Registered counter for database keystone Jun 22 05:52:05.422680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG oslo_db.sqlalchemy.engines [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 05:52:05.429336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writer thread running {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 05:52:05.548085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff470ab-c00a-41f5-85be-02c64b81728a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:05.552314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:05.552973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:05.553259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:05.553538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:05.561828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:05.617859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 05:52:05.618203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4449f9-c95d-4e81-9aba-b67df0f074c1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:05.627865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Jun 22 05:52:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 05:52:05.633728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:05.648551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acc5a4-41f4-423c-81e5-4a2fc56655e7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:05.652939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:05.654048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:05.654341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:05.654621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] PATH_INFO: `/v3/projects/a72d8da337ee49b5b2420009a5f9bd45` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:05.658673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a72d8da337ee49b5b2420009a5f9bd45)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:05.710552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 05:52:05.710905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885c1de-cf27-440d-8770-64818abd2bb0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:05.715765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Jun 22 05:52:05 2022] GET /identity/v3/projects/a72d8da337ee49b5b2420009a5f9bd45 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:07.719665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3947df-1077-4204-a563-aefbca5a3ef3 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:07.720186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3947df-1077-4204-a563-aefbca5a3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:07.720281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3947df-1077-4204-a563-aefbca5a3ef3 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:07.724364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:07.729679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:07.730056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:07.730243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:07.749175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:07.750699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:07.759079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 05:52:07.781030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3947df-1077-4204-a563-aefbca5a3ef3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:07.793074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3947df-1077-4204-a563-aefbca5a3ef3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:07.797323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:07.797942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:07.798221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:07.798492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:07.807160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:07.808964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4cad-5e93-4425-8953-32e73cf1d6a4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:07.818311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Jun 22 05:52:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 05:52:07.823953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:07.833041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5ddc1-c7fb-4b0d-8b3d-47efd60d804b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:07.837459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:07.838318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:07.838605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:07.838886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:07.840589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:07.842417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dc083-adc4-4e18-b68d-493b5b895f47 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:07.844039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Jun 22 05:52:07 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:09.899472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35348780-9527-4857-be6f-3da4bd66610d None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:09.900085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35348780-9527-4857-be6f-3da4bd66610d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:09.900085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35348780-9527-4857-be6f-3da4bd66610d None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:09.901421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:09.906562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:09.906981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:09.907150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:09.923375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:09.924565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:09.949847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3183-f3cf-473b-826c-4d9d8df84438 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:09.950133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3183-f3cf-473b-826c-4d9d8df84438 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:09.950416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3183-f3cf-473b-826c-4d9d8df84438 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:09.951800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:09.956553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:09.956846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:09.957121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:09.997215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG passlib.handlers.bcrypt [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79995) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 05:52:09.997873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG passlib.handlers.bcrypt [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79995) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 05:52:10.015680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:10.033452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.043364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:10.045005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:10.058426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.141461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619dad3-8d14-4750-bd82-4cc4952740b3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.152179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:10.170442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.176934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.177789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.178073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.178403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.190797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:10.202156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:10.203050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:10.203896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:10.209007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.281518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5db8f-d5da-4da0-9044-941ce550eecc None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.283823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.293630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.312212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e0f55-0957-441c-b771-ee49b175041d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.322066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.322953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.323241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.323547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.345619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.346279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.346564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.346844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.347629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:10.348447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.349843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.361454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:10.367698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.390435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.392002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.462741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ec444-dbe9-44e9-8e2b-a33fdeb0df10 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.489293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:10.494884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.497048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.498013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.498125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.498489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.498637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.499900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.501371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.503011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:10.508360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.522907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.591259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b35e4-bd7d-4137-ac43-bdb92bc866d3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.606618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7906-d153-4ace-9103-bbdcb4a37a16 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.625084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.625861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.626139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.626415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.640065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.640844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.641121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.641397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.642566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.644051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.650797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:10.651676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.658630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.661091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:52:10.684776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:10.685629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:10.686422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:52:10.686422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:52:10.686422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:52:10.686422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:10.686422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:10.692985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:10.734699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.750605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:10.755525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebc3a1-4588-4b90-ae17-a3a698ac6af0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.789704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.790351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.790641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.790919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.791802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.domain.id=default, user.id=201066f4889b4d3489fddb5528338862) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:10.792116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.793549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212eeb3-c8d8-4714-8e00-4704e6d7824f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.794722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a1e4-da85-4e1b-bbcf-3506b0e54a12 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:10.800386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/role_assignments?user.id=201066f4889b4d3489fddb5528338862&scope.domain.id=default&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:10.829153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:10.829826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:10.830113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:10.830390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:10.831143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:10.831450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:10.833460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49233a21-379e-4b31-9b74-5a4d4279ee21 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:10.853672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:13.172066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893c09-96fe-49ed-85c3-79235918c5a2 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.172599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893c09-96fe-49ed-85c3-79235918c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.172599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893c09-96fe-49ed-85c3-79235918c5a2 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.173976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:13.180371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.180804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.180999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.210401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:13.210401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:13.305763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:13.344989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77893c09-96fe-49ed-85c3-79235918c5a2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:13.473377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77893c09-96fe-49ed-85c3-79235918c5a2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:13.512474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:13.513260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.513540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.513812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.524238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:13.531875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:13.532751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:13.533515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 13/24] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:13.539679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:13.600651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:13.654812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151435-a7a0-4b8b-874b-e3da088478cd None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:13.691931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:13.692655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.692940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.693215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.694017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:13.694326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:13.695738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:13.709871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 12/25] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:13.716999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:13.721442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:13.837733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb647b3-08ab-482f-a2f0-cc902501ee23 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:13.872911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:13.873778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.874057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.874361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.875542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:13.877046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d49b23-1b78-4299-99ad-a7d3b473be16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:13.878708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 14/26] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:13 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:13.884338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:13.952458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d4649-35ad-43a2-a6d1-0de0559412ee None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.952772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d4649-35ad-43a2-a6d1-0de0559412ee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.953001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d4649-35ad-43a2-a6d1-0de0559412ee None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.954688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 15/27] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:13.960655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:13.960943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:13.961219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:13.978783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:13.979987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:14.017708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5510-681d-4b5e-ab3d-062cb2ebc2a4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:14.032896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:14.054582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:14.079080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:14.081319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:14.084673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:14.085474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.085761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.086041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.087660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:14.090560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7edd-8d25-4221-8583-2bddc6afff85 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:14.092404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 13/29] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:14.097397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ecf43-8820-4e20-9367-d83fcf547ae8 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.097840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ecf43-8820-4e20-9367-d83fcf547ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.098078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ecf43-8820-4e20-9367-d83fcf547ae8 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.099857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 14/30] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:14.104816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.105104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.105383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.146235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:14.146235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:14.247645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f943fe3-7c8b-4b5d-908a-f80ca81daafc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:14.323120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:14.323936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.324219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.324496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.325248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:14.332318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02273-8dfe-44db-8416-39bb621f47c7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:14.371022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 15/31] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:14.372643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:14.519868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 17/32] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 22 05:52:14 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:14.521487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b0da-5a1d-457d-87aa-0ab482d1943a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.521782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b0da-5a1d-457d-87aa-0ab482d1943a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.522071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052b0da-5a1d-457d-87aa-0ab482d1943a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.523294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 18/33] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:14.524402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b0da-5a1d-457d-87aa-0ab482d1943a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:14.677758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:14.730903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d4447-6fd8-4581-8d1a-4ebcc9cfc95e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:14.749396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:14.781193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052b0da-5a1d-457d-87aa-0ab482d1943a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:14.824580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:14.825464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.825749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.826028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] PATH_INFO: `/v3/domains/default/users/201066f4889b4d3489fddb5528338862/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.829506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=201066f4889b4d3489fddb5528338862, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:14.830975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:14.863082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:14.864510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.869436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.869743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.892804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:14.894445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5386c618-9ce0-42dc-a0b7-c4e5b5a19b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:52:14.927372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:14.928282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:14.929088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:52:14.929088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:52:14.929088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:52:14.929088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:14.929088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 19/34] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:14.930053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:14.930174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:14.935530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:14.973816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:14.975352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:15.005422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 16/35] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Jun 22 05:52:14 2022] PUT /identity/v3/domains/default/users/201066f4889b4d3489fddb5528338862/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:15.006507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:15.105026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 20/36] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:15.161056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:15.231351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f30da-81a7-4e69-b0d5-20d87425a30b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:15.263864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:15.292803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:15.293895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.294378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.294847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.295838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:15.296417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:15.298337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:15.323253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 17/37] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:15.333431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:15.373221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca742a-7aa8-4952-89ac-f5ace129f2a7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:15.385904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:15.414411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:15.415096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.415384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.415696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.416464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:15.417841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d437cc0-e6da-4f4a-bdc4-b6663fce3b43 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:15.450801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 21/38] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 22 05:52:15 2022] POST /identity/v3/roles => generated 225 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:15.504609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ec6e-235f-4258-a0e0-091a57ff6e89 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:15.556328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:15.557013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.557299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.557575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.558316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:15.559806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56e79b-5da6-47a3-a4ee-96b844d0d048 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:15.582109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5f74-500f-4324-a692-948b7e788ddf None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.582109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5f74-500f-4324-a692-948b7e788ddf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.582109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5f74-500f-4324-a692-948b7e788ddf None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.583800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 22/39] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:15.592374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.592677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.592934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.604406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 18/40] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:52:15 2022] POST /identity/v3/projects => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:15.606244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850913d1-1c3c-4b3f-8dfb-8415dda741fb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.606860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850913d1-1c3c-4b3f-8dfb-8415dda741fb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.607367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850913d1-1c3c-4b3f-8dfb-8415dda741fb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.609078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 19/41] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:15.615317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.616037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.616494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.627262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:15.628557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:15.643626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:15.646138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:15.752674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 20/42] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:15.780457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:15.788806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:15.800401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:15.818388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:15.875871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:15.928755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2aafc-b095-441e-a58e-b4a5eb30a55c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:15.973148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:15.974184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:15.974642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:15.975089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:15.976104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:15.977754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:16.005075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 21/44] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 22 05:52:15 2022] POST /identity/v3/roles => generated 223 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:16.089964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbedf8f-07b8-4c98-80b8-a4072744004c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:16.132308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:16.133181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:16.133476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:16.133758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:16.135038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:16.136573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737a41e-f551-4f58-8a21-aa3fdc3cb711 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:16.138265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 24/45] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:16.144095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:16.220861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:16.260501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2abf-16c1-4c7c-ba19-30c604451705 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:16.296794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:16.297464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:16.297875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:16.298170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:16.298893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:16.300455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269496-21c5-4537-a6f4-75b4eaf589b9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:16.326986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:52:16 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:17.599521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089520c5-b355-4947-a62b-ff674bf2f0c0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:17.599992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089520c5-b355-4947-a62b-ff674bf2f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:17.600080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089520c5-b355-4947-a62b-ff674bf2f0c0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:17.601456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:17.606520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:17.606892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:17.607142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:17.623936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:17.625196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:17.691834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:17.714622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089520c5-b355-4947-a62b-ff674bf2f0c0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:17.819773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089520c5-b355-4947-a62b-ff674bf2f0c0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:17.821309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:17.854980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:17.855722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:17.856008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:17.856285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:17.866495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:17.874064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:17.874894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:17.875768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 26/49] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:17.882682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:17.932687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:17.984485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b6a23-a6eb-4188-83df-7d3067de9f23 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.123429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.124578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.125087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.125480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.126244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:18.126558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.128356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.139683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 24/50] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:18.152349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:18.261127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce28c-750d-46c1-b60c-d8c961648098 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.294217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.295079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.295360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.295697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.296867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.298390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074822f-b990-45e1-90f4-dd804e7be14a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.300049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 27/51] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:18 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:18.305980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:18.377250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951778c7-c628-46c2-bc67-ec12d436cd22 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.377517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951778c7-c628-46c2-bc67-ec12d436cd22 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.377749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951778c7-c628-46c2-bc67-ec12d436cd22 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.379841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 28/52] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:18.384470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.384766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.385060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.401347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:18.402539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:18.407817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afa4a1-3b6e-4c92-bd63-01361f8a12a0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.421993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:18.427659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:18.447255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.448094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.448382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.448658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.450103 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.452524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.460273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 25/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:18.461394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:18.480458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 29/54] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:18.503388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:18.568196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdeb56-4280-48f1-9ee0-33c821236a1e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.603765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.604422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.604521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6324bb2-204c-4873-b381-365be67b2e88 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.604927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.604999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.605919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.domain.id=default, user.id=201066f4889b4d3489fddb5528338862) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:18.606235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.607829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.617653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 26/55] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Jun 22 05:52:18 2022] GET /identity/v3/role_assignments?user.id=201066f4889b4d3489fddb5528338862&scope.domain.id=default&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:18.651566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.652700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.653157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.653605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.655083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.656796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d158-3767-4727-a021-6e66d0edc506 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.658671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 30/56] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:18.665154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:18.716935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:18.781503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a107-30fe-45ce-a2bf-1705e97cbbbd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:18.817082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:18.817743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:18.818028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:18.818305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:18.819008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:18.820473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588143-c305-46ca-8d5b-d00597ed859a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:18.849188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 27/57] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Jun 22 05:52:18 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:20.883978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d536-db5b-4602-965c-52c6b723ccca None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:20.884495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d536-db5b-4602-965c-52c6b723ccca None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:20.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d536-db5b-4602-965c-52c6b723ccca None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:20.885890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 31/58] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:20.891016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:20.891422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:20.891628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:20.908097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:20.909297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:20.976965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:21.001834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4d536-db5b-4602-965c-52c6b723ccca None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:21.028973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:21.102175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4d536-db5b-4602-965c-52c6b723ccca None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:21.134461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:21.135193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:21.135479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:21.135784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:21.136951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:21.138402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8326-2265-4942-b3a1-18daf62fd1a2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:21.140206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 32/60] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:21.145996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:21.171903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:21.245743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb58ac-1b6e-436c-8bd5-ef834627cf25 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:21.279346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:21.280048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:21.280338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:21.280618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:21.281338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:21.282788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf37c5-96b8-4bab-ae0a-3927c9b1a091 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:21.308622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 29/61] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:21 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:24.473003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802da634-bb92-4d70-aa90-386ccfa5dfe9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.473525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802da634-bb92-4d70-aa90-386ccfa5dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.473525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802da634-bb92-4d70-aa90-386ccfa5dfe9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.475016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 33/62] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:24.480457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5918-ea1f-4a12-ac15-322ef7f8f7a5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.480850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5918-ea1f-4a12-ac15-322ef7f8f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.481061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5918-ea1f-4a12-ac15-322ef7f8f7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.508514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6cef5918-ea1f-4a12-ac15-322ef7f8f7a5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:24.509729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6cef5918-ea1f-4a12-ac15-322ef7f8f7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:24.598173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 30/63] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:24.621957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802da634-bb92-4d70-aa90-386ccfa5dfe9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:24.727545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a613ca-d46a-47d1-ade6-6ec4e8cda61b None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.727822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a613ca-d46a-47d1-ade6-6ec4e8cda61b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.728080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a613ca-d46a-47d1-ade6-6ec4e8cda61b None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.729727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 31/64] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:24.736817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918373-7644-47e0-806c-daf5281d7636 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.737353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918373-7644-47e0-806c-daf5281d7636 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.737353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918373-7644-47e0-806c-daf5281d7636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.748129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:24.759853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802da634-bb92-4d70-aa90-386ccfa5dfe9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:24.796615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bb918373-7644-47e0-806c-daf5281d7636 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:24.797840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bb918373-7644-47e0-806c-daf5281d7636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:24.812752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:24.840247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:24.841077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.841336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.841612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.880112 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:24.887788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:24.888631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:24.889800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 34/65] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:24.895899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:24.978190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 32/66] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:24.982893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a83a-e960-41bb-ab78-df42cad459c5 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:24.983189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a83a-e960-41bb-ab78-df42cad459c5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:24.983474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90a83a-e960-41bb-ab78-df42cad459c5 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:24.984957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 33/67] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:25.000574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.000873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.001155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.027293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:25.028628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:25.061568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dcf9-b776-46ca-9a59-f23a6cd06bcb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.099302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.100110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.100575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.100927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.101843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:25.102220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:25.103790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:25.109762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:25.110610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.130069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:25.135816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.174095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.227585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.279887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f33d-b1b8-4119-91ca-d9e3df0c4880 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.311416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c6338-3052-4e70-9823-425038559b6f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.316596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.317853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.318341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.318813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.334268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:25.336261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:25.338239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:25.339462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.386257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.387224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.387400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.387714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.420164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:25.423116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:25.431409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:25.432325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:25.433097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:25.440868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:25.442353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.452250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ea5fa-2403-4ccc-9b8c-8d2ce061686c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.489728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.491328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.491833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.492326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.524188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:25.536790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:25.537675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:25.538420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:25.541113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:25.541938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.667660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af024-8e64-455c-a67e-edba8a550dbb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.695484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2f40-e042-42e3-b59b-584e1fd87d09 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.711036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.712338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.712642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.712926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.713748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:25.714330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:25.715766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:25.718601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.727458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 38/73] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:25.732595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.779967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.804320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.804921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.805216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.805506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.844955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c4807-df6e-4f0c-b277-70dbdbfad03a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:25.883228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:25.884027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.884271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.884487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.884997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:25.885245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:25.885556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:25.886488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633522-4a70-4082-a53f-91cfa067569d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:25.886940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:25.895278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 39/74] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:25.895999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:25.956141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:25.994273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 36/75] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:25.996051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d48a-ecc6-417b-8ead-3aeff4e68e29 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.996347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d48a-ecc6-417b-8ead-3aeff4e68e29 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.996629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d48a-ecc6-417b-8ead-3aeff4e68e29 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:25.998088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 37/76] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:25.999223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367a1-9781-4a50-a69d-1c43c604eab9 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:25.999628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367a1-9781-4a50-a69d-1c43c604eab9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:25.999885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367a1-9781-4a50-a69d-1c43c604eab9 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.001125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 38/77] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:26.005314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ab35e-0959-4dda-83bd-e536bada0f96 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.006411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc367a1-9781-4a50-a69d-1c43c604eab9 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.039069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.041440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.042320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.042611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.042906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.044276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.046546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.053161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:25 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:26.053161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.121402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc367a1-9781-4a50-a69d-1c43c604eab9 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.161311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e61606-165e-49f2-93fb-57e4295b323d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.161838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.162959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.163243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.164396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.165623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.167202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb376ce-4312-44fb-bd81-3138b2bf0811 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.174289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 39/79] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:26.174289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.174289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.174289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.189550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.190969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:26.192595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:26.198934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.199816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.200106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.200387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.201683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.203143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980682f4-a5be-4795-a71f-98ae2125428f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.209594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:26.209594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.209594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.209594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.233547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:26.234727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:26.279528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 40/81] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:26.279528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.313053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.321095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:26.322153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.401001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9171e-e1d7-4f16-8424-02304c133fb6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.425028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75aea4-bde4-47ba-99ad-0cd9768b24b1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.437763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.438405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.438688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.439077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.452251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.462119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.462771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.463059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.463339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.512118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.513588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.535429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.536994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.543714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.624856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:26.624856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.645958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:26.647140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.676773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.741557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b516ed-cbdf-489b-8acd-f629d1d22f92 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.757611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980d71-1f65-4c11-aba9-443efbfc06e1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.772302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.782822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.783592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.783876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.784159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.785020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:26.785335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.786786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.792508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=b82d7152a4f64644aafded785d073762 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:26.793299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.807266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.809584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.810128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.810585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.826013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:26.834701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:26.835819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:26.836599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:26.839246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 44/86] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:26.840122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:26.937093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f65c3-2155-4598-9d78-10296f964255 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.939536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:26.954728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdba26d-4dd3-455a-ac5b-4ed96b75e303 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:26.994107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.994935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.995218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.995492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.995904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:26.996736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:26.997169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:26.997647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:26.998233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:26.998342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:26.999850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.004883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 43/87] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.004883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.006879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.008865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 45/88] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:26 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.009815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.076280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:27.125438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c678f-9c58-4450-bcde-160a29727478 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.127020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c361e-22e7-4768-8e8d-3eb8cad99635 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.163108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.163813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.164153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.164772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.165793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:27.166104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.167496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.169961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.171114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.171683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.171909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.173165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.174706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.176357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 46/89] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.176844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 44/90] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.177220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.182191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.215921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:27.308087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964df7-b2de-473f-92fe-9aac26e52d5d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.312838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f1001-bc83-454f-86a6-75c68236ecbc None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.347046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:27.355630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.356294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.356582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.356861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.357701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=201066f4889b4d3489fddb5528338862) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:27.357902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.358011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.358570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.358856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.359134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.359448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.359893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.361660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.366067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 45/91] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/role_assignments?user.id=201066f4889b4d3489fddb5528338862&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.366709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.415204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 47/92] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:27 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:27.416110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.552050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af643a9b-0634-4535-8768-4396f6ccaa22 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.600981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.601897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.602181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.602464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.605041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.606546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.608372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 46/93] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.614364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:27.629346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:27.663109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085af55-61ac-49f6-ba64-af99750c0276 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.702346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.703337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.703809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.704348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.705377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:27.705862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.707724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.713901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 48/94] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:27.746640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:27.802170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f877-576c-4779-ba0e-d8245741fdfb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:27.840212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:27.841267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:27.841744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:27.842259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:27.920151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:27.921989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:27.988675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:28.031531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 47/95] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:28.040493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:28.175403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf07da-9a7f-4055-ba9e-f7b73024eb44 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:28.236422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:28.237290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:28.237572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:28.237875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] PATH_INFO: `/v3/projects/2f53857ccacb4b13b0637fc699bb46fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:28.239375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=2f53857ccacb4b13b0637fc699bb46fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:28.240873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77942606-987f-404d-a00d-7e625d4e1cb1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:28.242957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:28 2022] GET /identity/v3/projects/2f53857ccacb4b13b0637fc699bb46fe => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:28.248726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:28.380749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5849b-7335-4931-87a3-d995c0a54995 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:28.422721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:28.423734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:28.424209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:28.424674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:28.425799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2f53857ccacb4b13b0637fc699bb46fe, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:28.426302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:28.427974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0fcbe-e1f9-400f-84b3-3fd83aa37002 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:28.439693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 48/97] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:28 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=2f53857ccacb4b13b0637fc699bb46fe&role.id=b82d7152a4f64644aafded785d073762 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:29.450150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a79e-dd32-4a42-b326-b554578c2241 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:29.450647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a79e-dd32-4a42-b326-b554578c2241 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:29.450719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a79e-dd32-4a42-b326-b554578c2241 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:29.452247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 50/98] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:29.464603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:29.465060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:29.465165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:29.487596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:29.489258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:29.518914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:29.578209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 49/99] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:29.614631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a79e-dd32-4a42-b326-b554578c2241 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:29.623361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:29.760733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a79e-dd32-4a42-b326-b554578c2241 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:29.802691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:29.803477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:29.803794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:29.804074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:29.818145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:29.825854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:29.826728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:29.827917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 51/100] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:29.834776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:29.961477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401817-abf4-4ff0-86cd-131e63c09850 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:29.997363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:29.998128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:29.998424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:29.998704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:29.999463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:29.999805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:30.001188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:30.009606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 50/101] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:30.015403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:30.115056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:30.161786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bc12-130a-44ca-8079-0d22c819054d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:30.216292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:30.217190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:30.217474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:30.217755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:30.219001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:30.220480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:30.222981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 52/102] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:30 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:30.228608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:30.258891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:30.360993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08a84e-b5fe-4255-a908-ae84eff4fa7a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:30.395812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:30.396686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:30.396973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:30.397252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:30.398637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:30.400160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84a266-e253-4f51-bd19-9d22d5046510 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:30.402170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 51/103] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:30 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:30.408215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:30.562555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b46718-4206-442b-a66f-c47b488f6951 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:30.604770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:30.610382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:30.611605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:30.612270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:30.612741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:30.621091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, user_id=ba7ff7e4d70b4e069dca3cfaa238a67f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:30.622885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968e48-7681-46d2-96fd-f59e2b67b1f6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:30.652271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:30 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:30.961666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda80d-6820-4b2d-b281-176493bb1f46 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:30.962136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda80d-6820-4b2d-b281-176493bb1f46 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:30.962136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beda80d-6820-4b2d-b281-176493bb1f46 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:30.963834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 52/105] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:30.969238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:30.969850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:30.970326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:30.989621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:30.991105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:31.072731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 54/106] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:31.109126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beda80d-6820-4b2d-b281-176493bb1f46 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:31.231433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:31.250840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beda80d-6820-4b2d-b281-176493bb1f46 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:31.292759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:31.293550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.293837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.294119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.305225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:31.314017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:31.314932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:31.315785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 53/107] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:31.322249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:31.427804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac1774-9da5-4b79-b2e2-903dac259e96 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:31.451667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:31.464769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:31.465797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.466609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.466887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.467703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:31.468286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:31.469728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:31.479129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 55/108] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:31.484846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:31.598879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804723a-bd60-474a-ad09-3a543fac1b10 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:31.648239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:31.649179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.649467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.649749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.651113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:31.652682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:31.654755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 54/109] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:31 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:31.660854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:31.794118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b06b-f0ba-4802-b0d4-945a7bb0ac47 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:31.841595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:31.842843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.843856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.844327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.845741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:31.848022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c145ab9-c4e5-44ff-a896-4ce2fbfb580e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:31.850390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 56/110] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:31 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:31.856729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:31.883386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:31.968579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef62-3c20-4d3e-8052-f15caf82f8dc None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.969313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef62-3c20-4d3e-8052-f15caf82f8dc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.969817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ef62-3c20-4d3e-8052-f15caf82f8dc None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.971480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 57/111] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:31.977018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063789-1d03-4474-a02e-9988ba47deef None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.977522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063789-1d03-4474-a02e-9988ba47deef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.978013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063789-1d03-4474-a02e-9988ba47deef None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:31.979794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 58/112] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:31.985061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:31.985560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:31.986030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.001994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388a8a5-1efa-4ede-a34e-a5c299f59577 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:32.024653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:32.026252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:32.046787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:32.047633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.047974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.048257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/201066f4889b4d3489fddb5528338862/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.057015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, user_id=201066f4889b4d3489fddb5528338862, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:32.058691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ddbe-857c-4a5e-9e13-c843a29108df None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:32.090522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 55/113] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:31 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/201066f4889b4d3489fddb5528338862/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:32.091882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685244d-3870-4be6-8468-846cf418f98e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.092162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685244d-3870-4be6-8468-846cf418f98e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.092435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685244d-3870-4be6-8468-846cf418f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.129178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4685244d-3870-4be6-8468-846cf418f98e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:32.130389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4685244d-3870-4be6-8468-846cf418f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:32.173533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:32.229833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 59/114] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:32.254471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 56/115] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:32.264831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:32.292978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685244d-3870-4be6-8468-846cf418f98e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:32.301017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:32.408551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685244d-3870-4be6-8468-846cf418f98e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:32.446685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:32.447486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.447796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.448077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.449768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:32.450770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969aa2-b21d-4565-a6b6-166d91f2b592 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:32.457554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 57/116] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:32.458911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8f39-2708-4c7c-a53d-639e9573bbee None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.459202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8f39-2708-4c7c-a53d-639e9573bbee None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.459482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8f39-2708-4c7c-a53d-639e9573bbee None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.460809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 58/117] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:32.461898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8f39-2708-4c7c-a53d-639e9573bbee None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:32.462002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d80aa-ba6f-42e0-9fba-e41aa293a50b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:32.522561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:32.523873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.524420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.524707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.539647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c6f20e1a-1ed6-4107-93fb-0010094cd531 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:32.549389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:32.550899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:32.552133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 60/118] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:32.555551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a077-9fcd-48b3-8adf-70f9027404ad None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.555551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a077-9fcd-48b3-8adf-70f9027404ad None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.555551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59a077-9fcd-48b3-8adf-70f9027404ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.563160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:32.580871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9c59a077-9fcd-48b3-8adf-70f9027404ad None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:32.582512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9c59a077-9fcd-48b3-8adf-70f9027404ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:32.605292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8f39-2708-4c7c-a53d-639e9573bbee None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:32.623152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:32.670146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:32.671361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.671894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.672361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.673309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:32.675006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773094-3c41-4463-89ad-2efb8d1e0ba6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:32.690137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 61/119] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:32.691430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d5b0-0deb-460e-878d-2f971badcf04 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.691744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d5b0-0deb-460e-878d-2f971badcf04 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.692022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20d5b0-0deb-460e-878d-2f971badcf04 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.699540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 62/120] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:32.699540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20d5b0-0deb-460e-878d-2f971badcf04 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:32.729362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 59/121] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:52:32 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:52:32.731493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.732241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.732719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.757470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:32.759128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:32.897269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:32.898148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:32.916277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20d5b0-0deb-460e-878d-2f971badcf04 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:32.993616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:32.994403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:32.994690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:32.994964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:32.995757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:32.996067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:32.997510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.014809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 63/123] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.017329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.030048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:33.087428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:33.122379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfafd9-95b9-4600-b221-6982fa63111b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.191276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.192067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.192350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.192626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.210380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:33.221804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b09ea-97cd-485f-bbfe-2b3493556922 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:33.225368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:33.226228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:33.226986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 61/124] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:33.227652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.292909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.293705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.293985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.294253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.321227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:33.329896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:33.330782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:33.331621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 64/125] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:33.332264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.423794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25301c-1d49-41f3-9cf6-8a153fa7afd0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.455373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:33.488460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:33.493539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.494283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185f7f-1d4a-41ba-bb0a-2dc248c1b04a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.494424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.494698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.494984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.500388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:33.502712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.504746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 62/126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.505946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.595547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.595547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.595547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.595547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.595907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:33.595907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:33.595907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.616422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 65/127] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.617178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.665517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aa0bb-6de8-474e-b8b1-d7b0fc02beae None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.703355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.704443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.704920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.705515 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.706543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:33.707076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:33.708692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.718511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 63/128] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.719742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.785917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:33.873771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075eb57-8876-4e9d-8e48-8cc42f611356 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.877533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9abd-79bb-4f55-b761-7b4607c7f115 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:33.933359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.934224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.934508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.934785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.936418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:33.937861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.939570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 66/129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.940419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:33.941979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.942259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.942536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.943724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.944816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:33.946254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effad81-e36f-48cc-a2f8-f5adc1cc05bb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:33.948039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 64/130] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:33.951546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2d62-48a9-4ca2-8c4c-b1872224965a None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:33.951843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2d62-48a9-4ca2-8c4c-b1872224965a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:33.953885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2d62-48a9-4ca2-8c4c-b1872224965a None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:33.956627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 65/131] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:33.957296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2d62-48a9-4ca2-8c4c-b1872224965a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:33.996790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:34.075920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc005-21f2-4b0c-a6b2-445b6bc08c9f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.116259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.117149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.117435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.117714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] PATH_INFO: `/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.135538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a55964bf7c48fc9056bb8067b1f7fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:34.137466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:34.139847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 67/132] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:33 2022] GET /identity/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:34.140630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:34.142184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2d62-48a9-4ca2-8c4c-b1872224965a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.177410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:34.222343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.223912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.223912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.223912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.232449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, user_id=ba7ff7e4d70b4e069dca3cfaa238a67f, role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:34.233948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97987-6594-4254-a2e0-00a88b8266ef None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:34.255961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:34.263584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 66/133] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:33 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/792bbf94ba3642c79d76ead64a6b33be => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:34.269628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e913-12c7-435a-80dc-ef07d9b77c15 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.270136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.270597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.270886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.303578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:34.304803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:34.318415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.319773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.320361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.320845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] PATH_INFO: `/v3/projects/2f53857ccacb4b13b0637fc699bb46fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.328715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] RBAC: Authorizing `identity:get_project(project_id=2f53857ccacb4b13b0637fc699bb46fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:34.330670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:34.333876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 68/134] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:34 2022] GET /identity/v3/projects/2f53857ccacb4b13b0637fc699bb46fe => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:34.335306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:34.484359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 67/135] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:34.484931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:34.498108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d5b74-a3f5-47b5-9701-62f97548a57e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.562964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a494-5947-473b-b988-61e166a0737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.563640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a494-5947-473b-b988-61e166a0737d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.563926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a494-5947-473b-b988-61e166a0737d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.564202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a494-5947-473b-b988-61e166a0737d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.611862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:34.632907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fcdb0-99fd-460f-b7f2-4ed74f6ff6a5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.634421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:34.680239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.681138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.681424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.681698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] PATH_INFO: `/v3/projects/2f53857ccacb4b13b0637fc699bb46fe/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.687260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] RBAC: Authorizing `identity:create_grant(project_id=2f53857ccacb4b13b0637fc699bb46fe, user_id=ba7ff7e4d70b4e069dca3cfaa238a67f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:34.688756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:34.724038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 68/136] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:34 2022] PUT /identity/v3/projects/2f53857ccacb4b13b0637fc699bb46fe/users/ba7ff7e4d70b4e069dca3cfaa238a67f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:34.724652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:34.729070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987a494-5947-473b-b988-61e166a0737d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:34.736599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987a494-5947-473b-b988-61e166a0737d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:34.922280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635c41-eb95-4ed8-8625-2a0a6dcbf7ce None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:34.975383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:34.976610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:34.977104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:34.977608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:34.998023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:35.006861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:35.007860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:35.008643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:35.012818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 69/137] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:35.014716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 69/138] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:35.020520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a494-5947-473b-b988-61e166a0737d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.024462 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.071120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:35.131220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:35.203960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a494-5947-473b-b988-61e166a0737d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:35.206296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58490d9b-e9b0-46ee-bea2-87ee1773a8b4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:35.274488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:35.275391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.275790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.276065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.279138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:35.280737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e001d5-314b-481c-b50d-fa0148d98320 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:35.282455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 70/139] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:35.283785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221e43-ee08-43a1-bf13-1cbf21e39ce9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.284074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221e43-ee08-43a1-bf13-1cbf21e39ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.284348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9221e43-ee08-43a1-bf13-1cbf21e39ce9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.286458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 71/140] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:35.286665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:35.287440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.287750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.288029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.288792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:35.289101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:35.294383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:35.294740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.295034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.295315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.311134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 70/141] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:35.312110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.332974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:35.334178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:35.452904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:35.476222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9fdfa-635d-4f42-bf32-14800b67bd9d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:35.476963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 72/142] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:35.477910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.527015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:35.527613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.527903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.528182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.529022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=a9a55964bf7c48fc9056bb8067b1f7fe) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:35.529338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:35.530809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:35.537022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 71/143] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/role_assignments?user.id=a9a55964bf7c48fc9056bb8067b1f7fe&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:35.545219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.581986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:35.651396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c57d8-f23f-4194-ae32-0ba50cf3219f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:35.692315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:35.693113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.693401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.693679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.714762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:35.722531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:35.723564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:35.724380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:35.724981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 72/144] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:35.729796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a1fc-4e11-4204-888d-e1c9d4045ead None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:35.740229 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.767900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:35.796363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:35.797155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:35.797434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:35.797708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:35.799904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:35.801409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:35.803370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 73/145] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:35.810774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:35.943674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01c6ba-e2a7-4b73-bfbb-befb3f094812 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.004216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.004880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.005162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.005433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.006190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:36.006494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.007901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.011030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd17a-8b46-4dfb-8630-7874aaeb789d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.027490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 73/146] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:36.034407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:36.049169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:36.073495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.074149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.074435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.074713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.170976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.172538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.221490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:36.306613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2946-e20e-4f0c-ba5c-101ceb2c12e4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.369690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:36.373118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.373996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.374278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.374554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] PATH_INFO: `/v3/users/201066f4889b4d3489fddb5528338862` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.375449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:36.375803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] RBAC: Authorizing `identity:get_user(user_id=201066f4889b4d3489fddb5528338862)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.377402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.379900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 74/148] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:36 2022] GET /identity/v3/users/201066f4889b4d3489fddb5528338862 => generated 247 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:36.389882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:36.403807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:36.559355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240e230-2c45-4eb8-9890-7f7ec6bef04a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.626960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113dde-7cb8-4953-86f7-1524ff4bebfe None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.634020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.634900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.635183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.639698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.639698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.639698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6690-7349-4d21-85f4-8ef6e827fb14 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.640765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 75/149] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:36 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:36.642045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b00b9-5151-4caa-aede-172b24203890 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.642335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b00b9-5151-4caa-aede-172b24203890 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.642615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b00b9-5151-4caa-aede-172b24203890 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.644345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 76/150] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:36.648866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b00b9-5151-4caa-aede-172b24203890 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:36.728226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.728883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.729202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.729482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.748892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:36.763856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:36.796365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b00b9-5151-4caa-aede-172b24203890 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:36.849227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.850614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.858673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:36.859338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.859643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.859916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.860751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:36.865059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:36.865059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80608676-fa51-400f-80fe-203f6ddb6650 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:36.868935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:36 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=b82d7152a4f64644aafded785d073762 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:36.870169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:36.870448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:36.870724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:36.893261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:36.895331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:37.044646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 75/152] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:37.050551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:37.053293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 78/153] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:37.102555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:37.132917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:37.259074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbcd9-135b-48ee-ba28-42556396d17f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:37.302995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:37.313280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:37.314450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.314941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.315421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.317538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:37.319200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:37.321265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 76/154] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:37 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:37.328215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:37.356708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15bc8c-7868-4f9c-8e84-eff6a6518034 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:37.444206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:37.445369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.445871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.446344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.447775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:37.449455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:37.451283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 79/155] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:37.468168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05823c4e-76a1-407f-af06-6fc101d1b574 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:37.476626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:37.478179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:37.508644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:37.509301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.509587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.509863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.510759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=201066f4889b4d3489fddb5528338862) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:37.511074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:37.516806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dbb21-8eee-43ca-b763-338dab8842f8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:37.524234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 77/156] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:37 2022] GET /identity/v3/role_assignments?user.id=201066f4889b4d3489fddb5528338862&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:37.640182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb8ae-3f18-49d0-80d7-b0a0b1f7421a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:37.683219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:37.683931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.684212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.684488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.685213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:37.686664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aea5e-58f5-4d82-b36f-ef0d8a6d32d8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:37.721290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 80/157] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:37 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:37.910995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ef9c-2a1c-4a5e-bd86-0ace429ee5f2 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.911197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ef9c-2a1c-4a5e-bd86-0ace429ee5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.911465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ef9c-2a1c-4a5e-bd86-0ace429ee5f2 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.913156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 78/158] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:37.918554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:37.918854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:37.919139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:37.925797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:37.943914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:37.945137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:38.031616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 81/159] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:38.060969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9ef9c-2a1c-4a5e-bd86-0ace429ee5f2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.194794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9ef9c-2a1c-4a5e-bd86-0ace429ee5f2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:38.233083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:38.233889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.234165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.234434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.245659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:38.253848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:38.254708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:38.255488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 79/160] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:38.261838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.375889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8ed0-9206-4777-9c36-61befaa89d72 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:38.411953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:38.414980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:38.415786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.416077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.416416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.417181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:38.417554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:38.418965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09a0cc-0bb4-4ba4-bcaf-dd83c660254f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:38.428797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 82/161] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:38.434477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.476284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:38.541432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef662-0ed4-49cd-9aaf-fb6370e4f680 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.542056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef662-0ed4-49cd-9aaf-fb6370e4f680 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.542529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef662-0ed4-49cd-9aaf-fb6370e4f680 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.544459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 83/162] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:38.550392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.550953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.551325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.553639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effa52-8119-47c9-b6bb-2418751111f3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:38.576116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:38.577750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:38.614216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:38.615085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.615361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.615657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.620258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:38.621720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:38.623413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 80/163] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:38.629325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.669321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 84/164] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:38.693750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.784115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:38.791284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c829-009b-4871-bc6b-5ef5671ffaf4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:38.805644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435285a6-d34f-4f34-bfed-41bc6c855ebd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:38.828039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:38.828683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.828963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.829236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.834211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:38.848103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:38.849125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:38.849640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:38.850130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:38.861813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:38.871016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:38.872137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:38.873295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:38.875490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 85/165] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:38.881960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:38.904236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:38.905698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:38.995975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289c878-91e8-4fed-8d4f-d8684205fb10 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.007539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.011795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 81/166] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:39.018133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.035122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.036092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.036528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.036981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.037869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:39.038350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.039954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.049163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 86/167] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:39.055409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.105097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.126265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365e49-0f58-4613-a568-5548a2cbaabf None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.164345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.165194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.165530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.165808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.167107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.168480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409bc9-fdd7-4656-9e47-eae5127b631f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.170189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 82/168] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:39.171366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2edfa-1855-4a0a-9bf0-62eee582287f None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.171684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2edfa-1855-4a0a-9bf0-62eee582287f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.171934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2edfa-1855-4a0a-9bf0-62eee582287f None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.173168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 83/169] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:39.174119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0f93-be66-4318-ab0e-5a0e8d7fa5b9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.176612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2edfa-1855-4a0a-9bf0-62eee582287f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.211859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1119516-3705-443e-9419-578f186af48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.213372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119516-3705-443e-9419-578f186af48b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.213894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119516-3705-443e-9419-578f186af48b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.214616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1119516-3705-443e-9419-578f186af48b None admin] PATH_INFO: `/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.216237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1119516-3705-443e-9419-578f186af48b None admin] RBAC: Authorizing `identity:get_user(user_id=ba7ff7e4d70b4e069dca3cfaa238a67f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.217870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1119516-3705-443e-9419-578f186af48b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.219724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 87/170] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/users/ba7ff7e4d70b4e069dca3cfaa238a67f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:39.221192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.221731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.222261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.246058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:39.247386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:39.250027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.288960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2edfa-1855-4a0a-9bf0-62eee582287f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.323744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 88/171] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:39.325318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.340280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.340886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.341167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.341441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.342463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:39.342656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.344127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.350863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 84/172] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:39.361289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.398306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.446660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbe17-b2d4-49f5-9d9e-cae8e7dafd94 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.484386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.485418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.485879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.486327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.502163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d684-ddee-4bad-9bc8-007cb18a44d7 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.545409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.564660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.566572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.572211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.573020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.573303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.573578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.593825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:39.601961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:39.602853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:39.603801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 85/173] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:39.609176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.623901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.680241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 89/174] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:39.686115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.770342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746903ee-fe81-40c5-9e17-5375bd454194 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.804901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c244-05a2-4a9a-ae11-f22f8da985e9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:39.819225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.820093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.820233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.820437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.821190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:39.821494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.822854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.836477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 86/175] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:39.846048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.859025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:39.860357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:39.860832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:39.861313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] PATH_INFO: `/v3/projects/2f53857ccacb4b13b0637fc699bb46fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:39.863971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] RBAC: Authorizing `identity:get_project(project_id=2f53857ccacb4b13b0637fc699bb46fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:39.865724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:39.867656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 90/176] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/projects/2f53857ccacb4b13b0637fc699bb46fe => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:39.873641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:39.895842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:39.930350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:40.000540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818c786-ccfd-4314-937e-e53db3531024 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:40.060305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:40.061108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:40.061393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:40.061668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] PATH_INFO: `/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:40.062902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] RBAC: Authorizing `identity:get_user(user_id=a9a55964bf7c48fc9056bb8067b1f7fe)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:40.064364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:40.066350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 87/177] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:40.071711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:40.074315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ae96f-992c-4e73-9d95-6ff20f178dee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:40.148250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:40.148923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:40.149209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:40.149487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:40.150337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2f53857ccacb4b13b0637fc699bb46fe, user.id=ba7ff7e4d70b4e069dca3cfaa238a67f) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:40.150650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:40.152149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:40.168490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 91/178] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:39 2022] GET /identity/v3/role_assignments?user.id=ba7ff7e4d70b4e069dca3cfaa238a67f&scope.project.id=2f53857ccacb4b13b0637fc699bb46fe&role.id=b82d7152a4f64644aafded785d073762 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:40.191667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38500-a3f2-4fa5-a401-8e4f9e2aab0d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:40.218200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:40.228214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:40.229088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:40.229374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:40.229655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:40.231126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:40.232629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708d94-53ac-49f9-a4d5-f1209a072933 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:40.234562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 88/179] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:40 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:40.244645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:40.378754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:40.405700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a211226-acff-435a-9e9b-e9c6af7bc8be None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:40.456260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:40.457677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:40.457960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:40.458236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/a9a55964bf7c48fc9056bb8067b1f7fe/roles/832c1f6a16dd4ce394655caa347a9148` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:40.460284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, user_id=a9a55964bf7c48fc9056bb8067b1f7fe, role_id=832c1f6a16dd4ce394655caa347a9148)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:40.461782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633578e-fb54-4630-ada0-e1513ed87207 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:40.483418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 92/180] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:40 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/users/a9a55964bf7c48fc9056bb8067b1f7fe/roles/832c1f6a16dd4ce394655caa347a9148 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:41.391560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a0e5-4f82-4778-a09c-7ea9ab213bd1 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:41.392058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a0e5-4f82-4778-a09c-7ea9ab213bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:41.392160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a0e5-4f82-4778-a09c-7ea9ab213bd1 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:41.394144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 89/181] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:41.399263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:41.399674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:41.399837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:41.416830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:41.417992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:41.501982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:41.542993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a0e5-4f82-4778-a09c-7ea9ab213bd1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:41.666399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a0e5-4f82-4778-a09c-7ea9ab213bd1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:41.716570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:41.717359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:41.717639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:41.717911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:41.736340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:41.743901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:41.744757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:41.745536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:41.752186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:41.822226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:41.872078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902c75-4204-44b7-b4e3-af19d5dd2bed None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:41.922930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:41.923631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:41.923918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:41.924193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:41.924965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:41.925270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:41.926654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb61a-ac5f-4efe-9566-fcd1a7c4f2a3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:41.935129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 94/184] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:41.941053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:41.992232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355d50d-43fe-4476-ba83-439e44779286 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:41.992997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355d50d-43fe-4476-ba83-439e44779286 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:41.993563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355d50d-43fe-4476-ba83-439e44779286 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:41.995125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 95/185] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:42.000069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.000707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.001212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.020201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:42.021630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:42.068274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.130948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 96/186] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:42.157043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.166685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef211d2f-82c6-4215-b439-a99f2a4a53b8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.228425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.238253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.239209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.239517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.239877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.257511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.258986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd660d42-675d-4360-9e84-0f3c900fa1af None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.261012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 91/187] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:41 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:42.266484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78366-d842-4243-b1f8-1be3ac50f190 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.266786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78366-d842-4243-b1f8-1be3ac50f190 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.267076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78366-d842-4243-b1f8-1be3ac50f190 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.268394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 92/188] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:42.273030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891bad-bc69-4ec0-b17c-b5bd0e4e2531 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.273479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78366-d842-4243-b1f8-1be3ac50f190 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.310670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.313085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.313450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.313801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.315080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.319979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e206-bb7e-47a2-8eac-4e7c8908db1e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.321390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 97/189] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:42.322344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.322697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.323048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.340341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:42.341604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:42.383138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78366-d842-4243-b1f8-1be3ac50f190 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.392552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.413377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 98/190] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:42.414295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.436194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.436847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.437166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.437419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.473660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.520006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.520313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444439-2601-4924-98e2-f48d3eab382a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.521477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.555711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.556307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.556596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.556876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.557591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.559043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.586093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 99/191] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:42 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:42.587190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.665087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 93/192] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:42.670928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.687321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.714211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1528-ff68-4ea5-aa49-8084158d6a59 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.731886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:42.755962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.758002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.758376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.758657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.771997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:42.783144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:42.784724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:42.785516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 100/193] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:42.791418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.846717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a304f-a996-4098-bbfa-aab568cd77a6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.887803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.888993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.889467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.890051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.891447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.893228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.897039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 94/194] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:42.903021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:42.920907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4edec3-7d59-45ea-971d-09644e407000 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:42.963833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:42.964764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:42.965046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:42.965323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:42.966076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:42.966378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:42.968309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:42.977794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 101/195] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:42.983861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.001292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.031425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.043740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885180a-6f95-4263-ac23-adf450e0ff49 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.091318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.092340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.092994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.093508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.095022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=d2c60870869a46fd9ac3c2cf77c471ba) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:43.095580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:43.098476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:43.106454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 95/196] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/role_assignments?user.id=d2c60870869a46fd9ac3c2cf77c471ba&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:43.117256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83985-4b2c-45df-a46c-c211afadf9dd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.159950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.160836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.161149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.161393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.162715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:43.164216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c11f3-10ad-4c47-878f-8b8e1a18d090 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:43.166135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 102/197] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:42 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:43.171722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.300140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4039-7f00-4510-bdd6-365a4dc72658 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.336327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.336974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.337259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.337533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.346837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.385162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27682a8-655c-488d-b1b6-41c8efa823e4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.385476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27682a8-655c-488d-b1b6-41c8efa823e4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.385728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27682a8-655c-488d-b1b6-41c8efa823e4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.387361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 103/198] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:43.392666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.392957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.393234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.410412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:43.411972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:43.413880 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:43.415171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:43.499211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 104/199] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:43.526292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.562848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 96/200] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:43.566891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.585089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.613877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.716322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ffa1-1005-40af-8fcf-959e4a527e5d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.760660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.762192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.762693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.763159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.777791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:43.791526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3896f8-00be-4c28-b714-1cff861f1de6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:43.799140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:43.800707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:43.801492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:43.804015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 105/201] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:43.809749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.932548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:43.944208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9f58-fe86-4305-8478-173c84fcacf2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:43.947400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.948297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.948832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.949118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.950325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:43.951833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:43.953831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 97/202] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:43 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:43.960407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:43.996327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:43.997067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:43.997438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:43.997809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:43.998709 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:43.999120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:44.000810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:44.016329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 106/203] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:44.022018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:44.171103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aadf10-9d1d-427f-92f6-f583a7fc6a9d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:44.231098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:44.232141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:44.232491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:44.232773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] PATH_INFO: `/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:44.233996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a55964bf7c48fc9056bb8067b1f7fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:44.235527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:44.237561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 107/204] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:44 2022] GET /identity/v3/users/a9a55964bf7c48fc9056bb8067b1f7fe => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:44.242579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:44.283950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:44.337206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8766157-0e50-48d2-996e-8c7be8147e84 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:44.345285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:44.404804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:44.405454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:44.405733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:44.406006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:44.406839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=d2c60870869a46fd9ac3c2cf77c471ba) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:44.407148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:44.408763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:44.422570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 98/205] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:43 2022] GET /identity/v3/role_assignments?user.id=d2c60870869a46fd9ac3c2cf77c471ba&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 259 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:44.449556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ef879-5948-4038-bd90-aad7ba8f2db4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:44.513186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:44.513846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:44.514127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:44.514405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:44.608475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:44.609969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:44.636444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:44.717133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 108/206] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:44.723040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:44.854556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99db8-2beb-416b-a0c2-7a24423bf669 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:44.900327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:44.901102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:44.901386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:44.901663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:44.902851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:44.904331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acfb8f-a081-4973-b2d4-b4a29b4884a5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:44.906037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 99/207] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:44 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:44.912307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:45.039996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87205535-3ae4-449f-9365-19ac26f3c671 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:45.068272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:45.083836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:45.084492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:45.084772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:45.085044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:45.085869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb, user.id=a9a55964bf7c48fc9056bb8067b1f7fe) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:45.086177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:45.087649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742417f3-ed49-43b2-842f-86eb8c8be708 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:45.093964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 109/208] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:44 2022] GET /identity/v3/role_assignments?user.id=a9a55964bf7c48fc9056bb8067b1f7fe&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:45.829647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d96f4-0e02-4592-bdc3-2767eb2d9965 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:45.830148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d96f4-0e02-4592-bdc3-2767eb2d9965 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:45.830463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d96f4-0e02-4592-bdc3-2767eb2d9965 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:45.832238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 100/209] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:45.837637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:45.838038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:45.838208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:45.864064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:45.865243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:45.950931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 110/210] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:45.981957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d96f4-0e02-4592-bdc3-2767eb2d9965 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.046889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.137553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d96f4-0e02-4592-bdc3-2767eb2d9965 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.180301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.181077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.181360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.181628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.192271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-cd0af014-cfa7-4a8f-b89d-fab1a0d5b574 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:46.199954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:46.200860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:46.202085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 101/211] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:46.212634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.322238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e20c-92ab-438a-9808-5f02526d3e60 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.322554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e20c-92ab-438a-9808-5f02526d3e60 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.322803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e20c-92ab-438a-9808-5f02526d3e60 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.324618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 102/212] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:46.324875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fceff09-09b1-418a-a5f0-e706ed0698d0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.329669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474456a8-95f6-4aa9-a2fd-2db3c0510fee None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.329959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474456a8-95f6-4aa9-a2fd-2db3c0510fee None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.330237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474456a8-95f6-4aa9-a2fd-2db3c0510fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.345732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.358829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-474456a8-95f6-4aa9-a2fd-2db3c0510fee None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:46.360199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-474456a8-95f6-4aa9-a2fd-2db3c0510fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:46.370727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.371399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.371711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.371983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.374612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:46.374927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:46.376350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:46.399901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 111/213] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:46.407376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.470116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 103/214] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:46.471487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852826f-ed00-4f13-b83b-0d3e16ab76bc None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.478023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852826f-ed00-4f13-b83b-0d3e16ab76bc None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.478339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852826f-ed00-4f13-b83b-0d3e16ab76bc None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.480311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 104/215] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:46.485550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.485942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.486228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.517690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:46.519922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:46.533870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313a373-7eb2-4a14-9bca-6ac3c34ad099 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.552088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.576402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.577852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.578320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.578903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.580990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:46.582799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:46.585339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 112/216] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:46.586875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.601142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 105/217] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:46.602125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.646499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.709285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccb0-44ba-4074-bafc-944122553a32 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.720838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92a59-227b-4472-b8d5-14fc4936fcf1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.744317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.745169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.745454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.745727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.756982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:46.760744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.761920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.762436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.762925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.764514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:46.765024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:46.765887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:46.766753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 113/218] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:46.767410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.770014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:46.772358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 106/219] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:46.773426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.803527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.875717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fb4fd-a1ea-4db1-82aa-212a17d4cfa8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.883973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:46.887081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e68e0-7e42-4507-93dc-8ce3e874b7ae None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:46.921644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.922443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.922723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.923194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.924713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:46.926855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:46.928782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 114/220] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:46.929793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:46.930598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:46.931366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:46.931751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:46.932099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:46.933017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:46.933412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:46.935362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:46.944685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 107/221] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:46.945736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.039698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840048e-d6fa-49dc-9ca3-15ee6102f837 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.041935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.055695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6c124-151d-457d-929f-74c6e9f5eeaa None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.076087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.077127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.077410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.077685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/d2c60870869a46fd9ac3c2cf77c471ba/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.079896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, user_id=d2c60870869a46fd9ac3c2cf77c471ba, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.081533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.091694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.092367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.092652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.092930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.093634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.095054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c076e47-0ac2-46fc-aa41-c0b8a7780e1d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.096368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 115/222] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:46 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/d2c60870869a46fd9ac3c2cf77c471ba/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:47.097512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.119171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 108/223] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:46 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:47.125718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2c87-e680-47a8-8988-7a173d259614 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.125718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2c87-e680-47a8-8988-7a173d259614 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.126115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2c87-e680-47a8-8988-7a173d259614 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.132022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 109/224] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:47.141040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.147244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.147580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.147813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.187628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:47.188567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:47.235535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957c2d-2baf-44ce-89ca-ed41486bfb18 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.284858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.286825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.287403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] PATH_INFO: `/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.307464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] RBAC: Authorizing `identity:get_user(user_id=ca6f9cbc211f488583e6f3d066d0a3c7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.309212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.311149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 116/225] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:47.317132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.336952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 110/226] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:47.362819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.415200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.423797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b09da-a907-41d7-bd06-9d512b6086ad None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.451438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.460081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.460741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.461023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.461298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.484452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd151-a54b-40e3-8484-78f9072c07e8 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.535951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.536780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.537064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.537350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.542930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.544492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.552203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:47.563680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:47.564607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:47.565442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:47.566038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 111/227] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:47.574524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.674820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.686046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 117/228] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:47.692226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.712298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcba3d-56f8-47ed-bf33-922752c6c098 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.768913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.769835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.770138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.770415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.771466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:47.772241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.774177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.776255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.791151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 112/229] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:47.794013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.827152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87bd2a-1031-436e-b641-b03f930a1ddc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.880800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.881678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.881961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.882236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.884911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.886381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.888453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 118/230] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:47.895292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:47.934418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b58096-1076-4122-8106-48f27bff10ca None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:47.970205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:47.978902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:47.979946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:47.980333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:47.980614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:47.981839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:47.983272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:47.986007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 113/231] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:47.997285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:48.023898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb570-0f52-46cf-855a-9746d79bddea None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:48.064177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:48.064836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:48.065119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:48.065429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:48.066271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=ca6f9cbc211f488583e6f3d066d0a3c7) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:48.066581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:48.068800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:48.070458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:48.074875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 119/232] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/role_assignments?user.id=ca6f9cbc211f488583e6f3d066d0a3c7&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=b82d7152a4f64644aafded785d073762 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:48.114563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db87e-703d-4098-8994-b235fe12c355 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:48.150876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:48.151838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:48.152126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:48.152402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:48.153731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:48.155236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd402-2dc4-459d-8f0d-f8d5a7dd6dec None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:48.157164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 114/233] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:47 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:48.164669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:48.314248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dcf3-ed99-4549-b426-090eabe49367 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:48.338586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:48.350414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:48.351362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:48.351685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:48.352190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/d2c60870869a46fd9ac3c2cf77c471ba/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:48.354658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, user_id=d2c60870869a46fd9ac3c2cf77c471ba, role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:48.356160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b22a0-956d-40f4-88df-b039b1c2ead5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:48.375167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 120/234] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:48 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/d2c60870869a46fd9ac3c2cf77c471ba/roles/792bbf94ba3642c79d76ead64a6b33be => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:49.745328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e55a-9517-4d8a-82c5-e92ea8f9243c None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:49.746347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e55a-9517-4d8a-82c5-e92ea8f9243c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:49.746835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e55a-9517-4d8a-82c5-e92ea8f9243c None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:49.748493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 115/235] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:49.754004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:49.754802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:49.755279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:49.773514 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:49.775002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:49.843927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 121/236] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:49.867986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e55a-9517-4d8a-82c5-e92ea8f9243c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.008797 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e55a-9517-4d8a-82c5-e92ea8f9243c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:50.044074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:50.049032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:50.049890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.050108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.050392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.068341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:50.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:50.077006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:50.078212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 116/237] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:52:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:50.083826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.183288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8d3e6-623c-4e5b-bf81-81b4d6f8d375 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:50.197813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:50.229365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:50.230212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.230742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.231165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.232274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:50.232719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:50.234237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:50.243650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 122/238] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:50.249354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.369840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47072-fd7e-43e8-a76f-30311f27cbbc None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:50.413105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:50.414205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.414636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.415055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.416559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:50.418158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927bfb0-e08b-4aa9-a486-e0b05895244a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:50.419979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 117/239] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:50 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:50.426229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.532083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8341d08-7c0a-4b40-97d6-1a063c12e200 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:50.567252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:50.568208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.568672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.569125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.617363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:50.641281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:50.643015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:50.709625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccea2e-6ee9-4b16-84dd-610e34d0a423 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.710193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccea2e-6ee9-4b16-84dd-610e34d0a423 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.710651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccea2e-6ee9-4b16-84dd-610e34d0a423 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.712260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 118/240] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:50.728092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:50.728676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:50.729131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:50.751148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:50.753088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:50.784729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 123/241] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:50.791246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.834708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 119/242] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:50.835265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:50.872260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:50.968285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.018208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39902c9-e78d-4a39-9e01-53448cf85a12 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.051708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af02c-3340-4866-ab57-dabb606afbe7 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.091762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.092630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.092913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.093191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.097249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:51.100530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:51.100530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 124/243] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:50 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:51.111652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.124767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.126046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.126558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.127035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.130607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:51.132370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:51.134602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 120/244] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:51.139553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.249365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.325759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2e9e3-993b-4ff8-b4cb-67e5d6490d1d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.330349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d938dbb-0af8-4886-9ef3-ebb90dd917d3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.374906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.375634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.375942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.376200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.376919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:51.379142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3c90b-760a-4cc6-814a-95f23ee37fa4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:51.379786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.380669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.381210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.381685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.382708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=d2c60870869a46fd9ac3c2cf77c471ba) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:51.383230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:51.384901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3c6a-0ae3-48fa-96ad-a6774092485d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:51.391495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 125/245] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:51 2022] GET /identity/v3/role_assignments?user.id=d2c60870869a46fd9ac3c2cf77c471ba&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:51.399530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252cb-afff-4ed4-ae5f-e464d53bae01 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.400237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252cb-afff-4ed4-ae5f-e464d53bae01 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.400705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252cb-afff-4ed4-ae5f-e464d53bae01 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.401697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 121/246] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:51 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:51.402555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 126/247] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:51.407851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23bcf-9d3f-478b-b534-9ebb0244b189 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.408157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23bcf-9d3f-478b-b534-9ebb0244b189 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.408429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23bcf-9d3f-478b-b534-9ebb0244b189 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.410601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 122/248] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:51.412626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.412982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.413320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.417309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.417600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.417883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.451871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:51.453114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:51.455316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:51.458320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:51.469232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.572179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 123/249] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:51.592080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 127/250] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:51.601653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.667012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.670228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.735764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ea9b-8518-46c6-a101-eaeba6eed200 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.774619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.776059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.776556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.777026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.789999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:51.791282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f86fb-64d8-49fc-be30-860fd1df79b5 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:51.799404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:51.800931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:51.801721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 124/251] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:51.810585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.856932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.857740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.858024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.858300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.870057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.878599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-35516e83-208e-41fc-b05d-19cdd4a790d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:51.886509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:51.887421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:51.888235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 128/252] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:51.890327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450d24-0910-43ca-a8f9-22a1d16899a9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.890327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450d24-0910-43ca-a8f9-22a1d16899a9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.890327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450d24-0910-43ca-a8f9-22a1d16899a9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.892792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 129/253] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:51.896815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450d24-0910-43ca-a8f9-22a1d16899a9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:51.931396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e00efe-b68f-489c-9e04-0e11a25d86ad None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:51.934198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:51.974083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:51.974789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.975039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.975314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:51.976111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:51.976418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:51.977806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f4ba0-0786-4b3c-b930-7444388f8ab3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:51.990720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 125/254] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:51.992875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:51.993494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:51.993971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.015893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:52.017107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:52.024336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450d24-0910-43ca-a8f9-22a1d16899a9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.068170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.072277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.072567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.072847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.074369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:52.074686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.076123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.089171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 130/255] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.090072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.109018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 126/256] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:52.110346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.224948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.253186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.262609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a55a6-4d0e-47ce-80f7-8bcf1c8ac3b4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.321010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fbd3-56f2-4c86-bfbb-244884dfa661 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.327096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.328026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.328281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.328553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] PATH_INFO: `/v3/users/f278aece0f5349c0a15fe5180c6cec42` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.356286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] RBAC: Authorizing `identity:get_user(user_id=f278aece0f5349c0a15fe5180c6cec42)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.357730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.359580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 127/257] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/users/f278aece0f5349c0a15fe5180c6cec42 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.360291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.362102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.363200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.363817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.364326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] PATH_INFO: `/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] RBAC: Authorizing `identity:get_user(user_id=ca6f9cbc211f488583e6f3d066d0a3c7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.367012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.368986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 131/258] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.372607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.486367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e8ac-9e03-402c-aafa-440caf997428 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.492788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4b0c2-6ea3-488e-96f5-d48126328b84 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.523963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.535277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.536248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.536779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.537223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.546634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.547650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.548035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.548408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.559820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:52.569900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:52.571096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:52:52.572092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:52.573961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 128/259] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:52.574837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.597758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.622310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.624241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.707071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1efccc-329a-4c79-ae64-ce2a2d38541f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.738814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 132/260] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:52:52.740065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.742119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.742968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.743665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.743927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.745123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.746573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.748519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 129/261] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.749194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.775111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.836828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:52.858037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6687-1fbf-4e38-b0f4-e48301b95a1b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.870861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbf6b-ecb6-4c75-bdd1-e22ab812217c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:52.895138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.896296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.896798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.897266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.898787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.900472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.902732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 130/262] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.903790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:52.911685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:52.912627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:52.913098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:52.913584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:52.914620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:52.915117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:52.916804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:52.925682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 133/263] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:52.926785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:53.015799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42718f9-d48d-48eb-9c5f-898c0910811b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:53.039970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:53.052088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b7ce-2888-4cc0-9b25-6e0899406dce None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:53.052924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:53.053841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:53.054130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:53.054410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/ca6f9cbc211f488583e6f3d066d0a3c7/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:53.057649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, user_id=ca6f9cbc211f488583e6f3d066d0a3c7, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:53.058298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:53.083757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 131/264] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:52 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/ca6f9cbc211f488583e6f3d066d0a3c7/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:53.084894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:53.095277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:53.096823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:53.097308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:53.097806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:53.098871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=f278aece0f5349c0a15fe5180c6cec42) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:53.099391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:53.101264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:53.107810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 134/265] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:52 2022] GET /identity/v3/role_assignments?user.id=f278aece0f5349c0a15fe5180c6cec42&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:53.108652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:53.279205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a62d40-1355-46a7-bc68-a200a4ca7e1a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:53.318652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:53.319558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:53.319848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:53.320124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] PATH_INFO: `/v3/users/d2c60870869a46fd9ac3c2cf77c471ba` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:53.321366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] RBAC: Authorizing `identity:get_user(user_id=d2c60870869a46fd9ac3c2cf77c471ba)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:53.322831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:53.324743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:53 2022] GET /identity/v3/users/d2c60870869a46fd9ac3c2cf77c471ba => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:53.330160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:53.474097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecba2e-f8cc-45ec-9d1d-418eb8057f85 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:53.547754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:53.548410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:53.548693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:53.548972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:53.585240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:53.642852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:53.645227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:53.777207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:53.782665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:53.878029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:53.909117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a829a-ea47-4fd9-a44e-2a52e25303e6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:53.959473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:53.960751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:53.961214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:53.961692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:53.963083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:53.964979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d8ec-d45c-46bb-b273-47098a49c87c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:53.966873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 133/268] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:53 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:53.972798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:54.056875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:54.117808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96d1b5-8cae-45b5-ac8c-96908de7d22a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:54.165770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:54.166266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.166550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.166828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.167275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3381-a75d-42de-b258-73e785e22e26 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.167602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3381-a75d-42de-b258-73e785e22e26 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.167703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=d2c60870869a46fd9ac3c2cf77c471ba) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:54.167892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3381-a75d-42de-b258-73e785e22e26 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.167988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:54.169430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 134/269] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:54.169535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:54.174096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09538e-0a37-435d-b572-4a3eb40ec558 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.174926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09538e-0a37-435d-b572-4a3eb40ec558 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.175211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09538e-0a37-435d-b572-4a3eb40ec558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.178001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 136/270] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:53 2022] GET /identity/v3/role_assignments?user.id=d2c60870869a46fd9ac3c2cf77c471ba&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:54.204394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bc09538e-0a37-435d-b572-4a3eb40ec558 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:54.205671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bc09538e-0a37-435d-b572-4a3eb40ec558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:54.318519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 135/271] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:54.343072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:54.456218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b1f29-43a6-4e53-9b34-9cf4669a7f4b None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.456558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b1f29-43a6-4e53-9b34-9cf4669a7f4b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.456784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b1f29-43a6-4e53-9b34-9cf4669a7f4b None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.458537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 136/272] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:54.469063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.469364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.469695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.474530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ad6d2-ce0a-42c9-b013-4b7889497315 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:54.503369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:54.504593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:54.508694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:54.536659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:54.538456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.538938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.539710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.541504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:54.543711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:54.546535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 137/273] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:54.552191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:54.592792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 137/274] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:54.618617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:54.627380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:54.673394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bae6-d806-4648-aa37-d42e96e06a13 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:54.728858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:54.729820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.730330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.730803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.731765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:54.733411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:54.763230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 138/275] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:52:54 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:52:54.765773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb45a1-ce73-49d3-b005-c3e38419ddf9 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:54.806544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:54.807352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.807671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.807951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.820125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:54.828260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:54.829201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:54.830020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 138/276] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:54.837858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:54.889632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:54.952805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89cf0b-82b4-48e4-b508-f68de6a5b8fa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:54.990030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:54.990707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:54.990974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:54.991247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:54.995142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:54.995142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:54.995142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:55.004345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 139/277] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:55.010264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:55.082578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:55.125751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d3492-650f-4eba-837c-d9dbf16cddef None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:55.165083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:55.165879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.166162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.166437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] PATH_INFO: `/v3/users/29e374dc890244b0800b6856415767fe` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.181197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] RBAC: Authorizing `identity:get_user(user_id=29e374dc890244b0800b6856415767fe)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:55.182677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0062b1-a1ca-422e-be3f-a56128ad7aff None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:55.184754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 139/278] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:55 2022] GET /identity/v3/users/29e374dc890244b0800b6856415767fe => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:55.190859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:55.309430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e89c-81fe-4788-8b66-a6c8757c1e5e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:55.311777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:55.350114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:55.350776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.351055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.351326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.352194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, user.id=29e374dc890244b0800b6856415767fe, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:55.352502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:55.353942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5d9b9-c1f6-4bae-a663-4126b0baaef5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:55.359691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 140/279] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 22 05:52:55 2022] GET /identity/v3/role_assignments?user.id=29e374dc890244b0800b6856415767fe&scope.system=all&role.id=b82d7152a4f64644aafded785d073762 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:55.515677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559949-727f-4821-ad7f-4fa21ebb6227 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.516292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559949-727f-4821-ad7f-4fa21ebb6227 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.516785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559949-727f-4821-ad7f-4fa21ebb6227 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.518467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 140/280] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:55.524384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df9097-fc25-431a-9d89-b29595047328 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.524680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df9097-fc25-431a-9d89-b29595047328 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.524942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df9097-fc25-431a-9d89-b29595047328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.544643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-32df9097-fc25-431a-9d89-b29595047328 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:55.545841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-32df9097-fc25-431a-9d89-b29595047328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:55.619393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358623b-ab41-4e84-9804-62b10455a91f None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.619749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358623b-ab41-4e84-9804-62b10455a91f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.619989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358623b-ab41-4e84-9804-62b10455a91f None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.621519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 141/281] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:55.626728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.627016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.627379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.630309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 141/282] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:55.653583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:55.654779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:55.665284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df9097-fc25-431a-9d89-b29595047328 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:55.738950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 142/283] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:55.776568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:55.839856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:55.844220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df9097-fc25-431a-9d89-b29595047328 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:55.891670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:55.892972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:55.894828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:55.898045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:55.906744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:55.917837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:55.925844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:55.926723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:55.927532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:55.929852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 142/284] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:55.935495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:55.975006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557fc48-798a-4df7-ab03-407bdc635deb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.013653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.014452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.014739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.015015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.038371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:56.054018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:56.055234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:56.056763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:56.060445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 143/285] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:56.068404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.135717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f591-5a45-43d8-9c8f-e1e61996140b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.171232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.172203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.172488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.172767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.173673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:56.173982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.176084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.186602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 143/286] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:56.192153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.197674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a770-2671-4349-a93a-f555bf30fcbd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.211897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:56.234179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.234855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.235143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.235426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.236220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:56.236531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.237959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.242974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:56.247534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 144/287] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:56.253412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.375023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18affa7-63ea-411e-9240-d7339a6183f9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.421206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4542-9354-41b8-92ae-714987c92378 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.443107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.445464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.446066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.447139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] PATH_INFO: `/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.449379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] RBAC: Authorizing `identity:get_user(user_id=ca6f9cbc211f488583e6f3d066d0a3c7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.451104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.454073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 144/288] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:56 2022] GET /identity/v3/users/ca6f9cbc211f488583e6f3d066d0a3c7 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:56.463119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.495439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.496562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.496987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.497512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] PATH_INFO: `/v3/users/f278aece0f5349c0a15fe5180c6cec42` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.499663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] RBAC: Authorizing `identity:get_user(user_id=f278aece0f5349c0a15fe5180c6cec42)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.505477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.509296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 145/289] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:56 2022] GET /identity/v3/users/f278aece0f5349c0a15fe5180c6cec42 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:56.515201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.608284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:56.643936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:56.657326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828689-8d8e-4222-b482-906418198fbe None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.714369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9114b0d-3f87-46d5-a2f0-cd0c23784dae None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.720332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.721677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.725652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.726110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.782798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:56.784642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:56.787076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:56.787517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:56.790355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.792017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.798350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:56 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:56.820308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:56.864554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:56.866022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:56.974081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcd840-4e79-4e29-bc50-31099c88c927 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:56.998955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.013252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.031972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 145/291] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:52:57.035373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.036362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.036645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.036918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/f278aece0f5349c0a15fe5180c6cec42/roles/832c1f6a16dd4ce394655caa347a9148` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.038525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.042349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, user_id=f278aece0f5349c0a15fe5180c6cec42, role_id=832c1f6a16dd4ce394655caa347a9148)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:57.043739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:57.071537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:52:56 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/users/f278aece0f5349c0a15fe5180c6cec42/roles/832c1f6a16dd4ce394655caa347a9148 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:57.165105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc595-4c9b-4bfa-b657-e0dd983810d6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:57.220321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.221753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.221753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.222299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.228498 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:57.229936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad71f7-4d7b-400e-91e9-3f51c45bc7cf None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:57.231931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:57.237847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.371814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19054-565e-4a4e-b2b4-24a22872c463 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:57.379119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0824-7c50-4aea-afbd-ba364a2c76c1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.379398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0824-7c50-4aea-afbd-ba364a2c76c1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.379921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0824-7c50-4aea-afbd-ba364a2c76c1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.381690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 147/294] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:57.387753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.388038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.388326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.410946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:57.412435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:57.429286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.429958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.430246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.430528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.431373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=ca6f9cbc211f488583e6f3d066d0a3c7) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:57.431893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:57.433455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06178-9af4-4852-99e1-dd107bcc1936 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:57.441318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 148/295] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/role_assignments?user.id=ca6f9cbc211f488583e6f3d066d0a3c7&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=b82d7152a4f64644aafded785d073762 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:57.474545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.488058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac576-4b7a-467b-a6fe-6630c5228b33 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.488265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac576-4b7a-467b-a6fe-6630c5228b33 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.488711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac576-4b7a-467b-a6fe-6630c5228b33 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.490589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 149/296] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:52:57.495965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.496273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 148/297] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:57.496745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.497160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.520609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:57.521864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:57.522017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.585780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.644996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 150/298] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:57.668365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.681554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6943760-9f29-4c8c-b6b6-e99594639403 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:57.732422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.733080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.733458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.733829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.747486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:57.755970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:57.757047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:57.758035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:52:57.759957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 149/299] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:57.766885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.811757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491715-c76a-4dd8-a8be-bb1a5e82e7f0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:57.838223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.857177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.858397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.858874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.859343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.860779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:57.863150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:57.865318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 151/300] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:57.870354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.902619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb3095-5978-480f-834f-a8419e8247af None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:57.914925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:57.942538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:57.943604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:57.944094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:57.944482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:57.945393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:57.945792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:57.947254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:57.956065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 150/301] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:57.961969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:57.997419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0dcb7-64fd-40f7-9ffc-1bb02420b2ae None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.039342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.040151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.040387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.040779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] PATH_INFO: `/v3/groups` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.041974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.043409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbba9-b7e0-4877-a114-a0c070d19cf0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.060379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 152/302] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Jun 22 05:52:57 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:52:58.060379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824bf1-7c4c-4ce1-8d79-73ca7559cdcd None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.060379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824bf1-7c4c-4ce1-8d79-73ca7559cdcd None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.060379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824bf1-7c4c-4ce1-8d79-73ca7559cdcd None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.060379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 153/303] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:58.069926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.070220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.070503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.087893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a58ea-3366-4d45-a18a-9ea19f291243 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.091376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:58.093554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:58.099999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:58.132247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.133388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.133904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.134188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] PATH_INFO: `/v3/users/f75eb3704ba045048b8d1e1efdddc42b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.149704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] RBAC: Authorizing `identity:get_user(user_id=f75eb3704ba045048b8d1e1efdddc42b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.151360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.158448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 151/304] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:57 2022] GET /identity/v3/users/f75eb3704ba045048b8d1e1efdddc42b => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:52:58.159973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:58.172613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 154/305] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:52:58.195391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:58.236262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:58.294129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf67b-6ff0-4bbf-a0b8-5ad8c4d0ac9c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.334806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acbcc9-a406-40d1-9a0c-4829a0c16855 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.338570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.339596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.339949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.340292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.341196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, user.id=f75eb3704ba045048b8d1e1efdddc42b, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:58.341572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.343076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.350764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 152/306] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 22 05:52:58 2022] GET /identity/v3/role_assignments?user.id=f75eb3704ba045048b8d1e1efdddc42b&scope.system=all&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:58.380911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.382004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.382424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.382854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.395565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:58.404016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:58.405188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:52:58.406285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:58.409380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 155/307] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:52:58.417827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:58.453023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:58.527815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a421f-ad7c-48d6-9617-601d82f31c43 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.564595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.565225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.565511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.565790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.566542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:58.566847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.568255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.576990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 153/308] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:58.582727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:58.676335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:58.693483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3312d-d770-46c9-8dde-cf7f7298b60d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.730072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.731281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.731835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.732303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] PATH_INFO: `/v3/users/29e374dc890244b0800b6856415767fe` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.733804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] RBAC: Authorizing `identity:get_user(user_id=29e374dc890244b0800b6856415767fe)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.735466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952acb2-9089-4816-8c3b-cdf29ec05b57 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.737686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 156/309] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:58 2022] GET /identity/v3/users/29e374dc890244b0800b6856415767fe => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:58.742949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:58.838249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:58.847578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabee5f-0dbe-43f4-952f-7dcafc79eae3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:58.881312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:58.882174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:58.882454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:58.882732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] PATH_INFO: `/v3/system/users/29e374dc890244b0800b6856415767fe/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:58.884222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29e374dc890244b0800b6856415767fe, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:58.885606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc24de-71c9-4b9d-9eee-9b9cb313960a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:58.898003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 154/310] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Jun 22 05:52:58 2022] PUT /identity/v3/system/users/29e374dc890244b0800b6856415767fe/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:52:59.517210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f566-d20f-43b4-8dfd-358e90ee1b32 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:59.518215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f566-d20f-43b4-8dfd-358e90ee1b32 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:59.518716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354f566-d20f-43b4-8dfd-358e90ee1b32 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:59.520326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 157/311] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:52:59.525863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:59.526663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:59.527134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:59.544001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:52:59.545439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:52:59.614264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 155/312] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:52:59.638118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f566-d20f-43b4-8dfd-358e90ee1b32 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:59.746762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354f566-d20f-43b4-8dfd-358e90ee1b32 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:59.780329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:59.781388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:59.781861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:59.782342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:59.794313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:52:59.804224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:52:59.805113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:52:59.805911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:52:59.808577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 158/313] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:52:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:52:59.814833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:59.900159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:52:59.918042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787dd81-26d9-49b8-ae9f-4dafac897e7b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:52:59.956430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:52:59.957434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:52:59.957930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:52:59.958393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:52:59.959335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:52:59.959878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:52:59.961435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:52:59.970671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 156/314] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:52:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:52:59.976960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:52:59.993754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.087393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff5f0-1613-494b-8123-14b29e96d0b5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.122853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.123760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.124097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.124374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] PATH_INFO: `/v3/users/f278aece0f5349c0a15fe5180c6cec42` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.125615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] RBAC: Authorizing `identity:get_user(user_id=f278aece0f5349c0a15fe5180c6cec42)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.127041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce8f2-c37f-4dc8-aac8-76e26c41d781 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.129037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 159/315] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:52:59 2022] GET /identity/v3/users/f278aece0f5349c0a15fe5180c6cec42 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:00.134510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.239870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e40-a75d-459e-ad7f-5a848cb7945d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.274357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.275055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.275337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.275639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.294441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.306047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e759ec5-f459-4688-bd8e-20da87884057 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.306326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e759ec5-f459-4688-bd8e-20da87884057 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.306599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e759ec5-f459-4688-bd8e-20da87884057 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.308419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 160/316] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:00.322703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.323181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.323698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.343571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:00.345534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:00.354266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.356199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.432559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 161/317] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:00.455736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.471873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.481134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 157/318] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:00.482504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.538904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.583014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1125e6a-a844-4684-be73-ca81ab8adbcc None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.594434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1c710-d46f-40f7-ae88-ff2206175ab5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.619998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.620930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.621291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.621575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.622743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.624243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee068c-c3c3-426f-bee6-8b9d96fd5d2f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.630089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 162/319] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:00.630089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0b3a-1e0e-40d5-b521-1fd743ae63f2 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.630089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0b3a-1e0e-40d5-b521-1fd743ae63f2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.630089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0b3a-1e0e-40d5-b521-1fd743ae63f2 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.630089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 163/320] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:00.631134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0b3a-1e0e-40d5-b521-1fd743ae63f2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.638923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.640077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.640699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.641078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.642263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.643935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea4b5-daa4-494e-8126-0eb1a87901fa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.650489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 158/321] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:00 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:00.650489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.650489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.650489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.667672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:00.669649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:00.720849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.741052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 159/322] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:00.741887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.757023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0b3a-1e0e-40d5-b521-1fd743ae63f2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.792932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.793921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.794384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.794835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] PATH_INFO: `/v3/groups` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.795753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.796626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:00.798099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.811890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 164/323] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Jun 22 05:53:00 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:00.812771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:00.883935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575437a-ebab-499f-bc6a-3451c86ef2f2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:00.925302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:00.926295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:00.926815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:00.927271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:00.928466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, scope.project.id=2cc788345296407ca5b3e77b126f8a56, user.id=f278aece0f5349c0a15fe5180c6cec42) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:00.928998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:00.930671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a610b5-f263-4835-949d-1e38cf822ff9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:00.938297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 160/324] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:00 2022] GET /identity/v3/role_assignments?user.id=f278aece0f5349c0a15fe5180c6cec42&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:00.975116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97060-d6c3-4b91-9e09-a2ad6151f790 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.013077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.013984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.014266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.014540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.015100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683854f-9ab0-4125-b3f3-8da51936c8a3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.015394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683854f-9ab0-4125-b3f3-8da51936c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.015728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683854f-9ab0-4125-b3f3-8da51936c8a3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.017404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 161/325] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:01.023565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.023859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.024136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.024696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:01.028075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:01.039641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:01.040628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:01.041461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 165/326] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:01.044186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:01.045493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:01.047792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.138852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 162/327] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:01.162788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.180608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f41b4-4bce-4412-adee-74900d59b6f4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.222180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.229337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.229337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.229337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.229337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:01.229337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.230243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:01.230317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.241988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 166/328] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:01.247469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.297895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e40ae-968f-46d9-b789-0cd4e5717ce0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.328138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:01.343200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.344029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.344320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.344594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.356421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:01.364255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:01.365151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:01.366090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 163/329] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:01.371107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.384790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd9b6e-16a1-4217-9f8e-8fe5219a04d2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.424268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.425442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.425935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.426352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] PATH_INFO: `/v3/users/f75eb3704ba045048b8d1e1efdddc42b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.427766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] RBAC: Authorizing `identity:get_user(user_id=f75eb3704ba045048b8d1e1efdddc42b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.429583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.431893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 167/330] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/users/f75eb3704ba045048b8d1e1efdddc42b => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:01.437654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.479398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:01.482710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77708e-146d-4de6-ad3d-4de9d03fa7cf None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.519906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.520723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.521106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.521556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.522420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:01.522821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.524347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.533363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 164/331] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:01.538913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.552361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd226-d098-4cef-8fdc-409643a136bb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.580383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:01.590667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.592167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.592708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.593168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] PATH_INFO: `/v3/system/users/f75eb3704ba045048b8d1e1efdddc42b/roles/832c1f6a16dd4ce394655caa347a9148` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.594974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f75eb3704ba045048b8d1e1efdddc42b, role_id=832c1f6a16dd4ce394655caa347a9148)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.607535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 168/332] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Jun 22 05:53:01 2022] PUT /identity/v3/system/users/f75eb3704ba045048b8d1e1efdddc42b/roles/832c1f6a16dd4ce394655caa347a9148 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:01.658186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd205-a0fd-4758-bdfd-bbde059015b8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.704214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.705206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.705550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.705824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] PATH_INFO: `/v3/users/29e374dc890244b0800b6856415767fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.707171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] RBAC: Authorizing `identity:get_user(user_id=29e374dc890244b0800b6856415767fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.708726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c3caa-a400-4b64-8c7a-373f03eab135 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.710638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 165/333] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/users/29e374dc890244b0800b6856415767fe => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:01.717702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:01.833524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a4a93-1325-447c-a46e-a8457fc057eb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:01.869395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:01.870046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:01.870327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:01.870601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:01.871425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] RBAC: Adding query filter params (role.id=b82d7152a4f64644aafded785d073762, user.id=29e374dc890244b0800b6856415767fe, scope.system=all) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:01.871770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:01.873209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eaa87-1b89-41c0-9ef7-6d9339c2a86f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:01.885999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 169/334] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 22 05:53:01 2022] GET /identity/v3/role_assignments?user.id=29e374dc890244b0800b6856415767fe&scope.system=all&role.id=b82d7152a4f64644aafded785d073762 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:03.394481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660472-66cf-4b33-a402-c5ef9a848921 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:03.394982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660472-66cf-4b33-a402-c5ef9a848921 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:03.395080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660472-66cf-4b33-a402-c5ef9a848921 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:03.396591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 166/335] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:03.401739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15629-8b67-45f4-8c32-4e6c28af31c9 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:03.402585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15629-8b67-45f4-8c32-4e6c28af31c9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:03.403060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15629-8b67-45f4-8c32-4e6c28af31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:03.420961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e3d15629-8b67-45f4-8c32-4e6c28af31c9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:03.422480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e3d15629-8b67-45f4-8c32-4e6c28af31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:03.482858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:03.506527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 170/336] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:03.516993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b380-1da3-466d-9bad-26c76713335e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:03.517477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b380-1da3-466d-9bad-26c76713335e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:03.517937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b380-1da3-466d-9bad-26c76713335e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:03.519444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 167/337] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:03.525565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:03.525855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:03.526134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:03.545823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:03.547009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:03.554181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7b380-1da3-466d-9bad-26c76713335e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:03.613564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:03.673699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 171/338] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:03.732804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:03.741744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7b380-1da3-466d-9bad-26c76713335e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:03.796179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:03.796982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:03.797265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:03.797545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:03.820435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:03.828322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:03.829214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:03.830999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 168/339] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:03.836584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:03.973700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e1215-7de5-432f-ac2b-be85f1a732b6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:03.995308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.019495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.039427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b6307-4a8f-4181-a84c-d519914947ba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:04.061287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.062111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.062396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.062676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.092579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:04.101679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:04.102579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:04.104059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 172/340] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:04.108968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:04.114148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.114891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.115182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.115460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.116294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:04.116607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:04.118005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:04.137813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 169/341] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:04.145218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:04.329247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec093-f4af-4585-bfe0-8f2c61bef801 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:04.366435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6475-6b4d-476b-b511-6a8a23d0b715 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:04.376196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.376876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.377696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.377980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.378745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:04.379056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:04.380473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52f6a-2311-4e61-9573-763fc9f7fac1 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:04.395182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 173/342] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:04.401468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b049-3082-4508-a3ad-d2a7a0d14774 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.401759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b049-3082-4508-a3ad-d2a7a0d14774 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.402276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b049-3082-4508-a3ad-d2a7a0d14774 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.403396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 174/343] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:04.408142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b049-3082-4508-a3ad-d2a7a0d14774 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:04.425927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.426585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.426918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.427202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.453500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.485376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.540553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:04.542510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428f91a-b9f3-4d12-894a-ff9f5df75d4d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:04.623948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b049-3082-4508-a3ad-d2a7a0d14774 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:04.660814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.661468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.661929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.662216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.692563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 170/344] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:53:04.694245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.694726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.695217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.715814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:04.717363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:04.755052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:04.756725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:04.776543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.797798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:04.801346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 171/345] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:04.803287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:04.916355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305390a1-3517-4c46-beff-4c40d4843c6f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:04.946332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 175/346] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:04.949807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:04.968816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:04.970043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:04.970549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:04.971557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:04.976135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:04.977611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:04.980334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 172/347] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:04.981028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.040994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.095092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3d496-e83f-4cea-814c-a6f72f2543ec None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.097843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895980-3db0-4395-97c8-eae5a31ad391 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.129578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.134636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.135990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.136468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.136702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.137152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.137435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.137785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.138138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.139077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.141224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292da24-ec7f-4547-8cda-aa9c5a83868b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.143601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 173/348] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.145043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c02a-be9b-4db5-9e7d-e3c50b1b507b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.145595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c02a-be9b-4db5-9e7d-e3c50b1b507b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.146076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c02a-be9b-4db5-9e7d-e3c50b1b507b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.147847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 174/349] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:05.149015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c02a-be9b-4db5-9e7d-e3c50b1b507b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.160717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:05.170153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:05.171186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 05:53:05.172046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:05.177166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 176/350] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:05.178331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.280746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c02a-be9b-4db5-9e7d-e3c50b1b507b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.297925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38fba-9d3b-4347-8267-33d641624a8b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.305234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.331405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.333284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.333722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.334143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.336791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.337769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.338127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.338529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.341920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.343966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c250fcd-e90e-4792-820d-0f6b220447c5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.346986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.347209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 175/351] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.348647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.348781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.349189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.349612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.350902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 177/352] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.351930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.379871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:05.381712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:05.431234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.476681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 176/353] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:05.477540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.507609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad041-191a-465f-829c-0f28c8e31ecb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.550284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.550957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.551238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.551547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.552464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:05.552769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.554657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.565204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 178/354] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.565824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.599164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bdd16-7c74-47e9-9b0f-f62ac19d73ab None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.613752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.647694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.648401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.648683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.648954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.649967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=b82d7152a4f64644aafded785d073762, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:05.650274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.652551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf19daf-6d86-46ee-9bae-e16eb8c719bb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.659904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 177/355] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=b82d7152a4f64644aafded785d073762 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.663304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a785f-6bae-479d-a6f2-83419c370d37 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.663613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a785f-6bae-479d-a6f2-83419c370d37 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.663903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a785f-6bae-479d-a6f2-83419c370d37 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.665911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 178/356] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:05.666563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a785f-6bae-479d-a6f2-83419c370d37 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.701943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3d497-12bb-464f-b7b1-0e2215202d1a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.727791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:05.754524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.755939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.756647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.757092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.758660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:05.759293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.761134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.772423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 179/357] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.773606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.821582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a785f-6bae-479d-a6f2-83419c370d37 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.864644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.865837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.866286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.866707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.882335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7420f636-4661-45f4-8a1a-77f9e6788c75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:05.890914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:05.891914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:05.892801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:05.896370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 179/358] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:05.898300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c306f-689e-4662-a498-22a5c6a1f8e4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.898927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c306f-689e-4662-a498-22a5c6a1f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.899386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c306f-689e-4662-a498-22a5c6a1f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.909584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba10d7-869a-466e-978d-2d22ed29e48f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:05.919852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-843c306f-689e-4662-a498-22a5c6a1f8e4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:05.921515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-843c306f-689e-4662-a498-22a5c6a1f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:05.948286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:05.949154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.949553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.949798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] PATH_INFO: `/v3/users/f75eb3704ba045048b8d1e1efdddc42b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.952126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] RBAC: Authorizing `identity:get_user(user_id=f75eb3704ba045048b8d1e1efdddc42b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:05.952608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e452-d0f0-429f-b8e5-96635ec21797 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:05.954424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 180/359] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/users/f75eb3704ba045048b8d1e1efdddc42b => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:05.959303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b51c2-e470-4d61-80b5-46566a69d623 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:05.959303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b51c2-e470-4d61-80b5-46566a69d623 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:05.959303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b51c2-e470-4d61-80b5-46566a69d623 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:05.959303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 181/360] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:05.959303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b51c2-e470-4d61-80b5-46566a69d623 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:05.964777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.011445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:06.012892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.013274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.013683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.028733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.054464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:06.055299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:06.102818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b51c2-e470-4d61-80b5-46566a69d623 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.141427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 181/362] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:06.142084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.152798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.153505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.153783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.154054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.155090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:06.155197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.156834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.167200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 182/363] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:06.168081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.266052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.274772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4655de5-ff09-4897-94ce-72cc409af14d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.300737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca178f-326e-45fb-bd7a-d21c4e7b3a22 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.316301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.323206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.324121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.324558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.325555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.326709 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] RBAC: Adding query filter params (role.id=832c1f6a16dd4ce394655caa347a9148, user.id=f75eb3704ba045048b8d1e1efdddc42b, scope.system=all) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:06.327301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.329613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.340749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.342050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.342050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.342463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.346341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 182/364] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/role_assignments?user.id=f75eb3704ba045048b8d1e1efdddc42b&scope.system=all&role.id=832c1f6a16dd4ce394655caa347a9148 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:06.347352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.356507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:06.366314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:06.367324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:06.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:06.368802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 183/365] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:06.369975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.497540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298afc7-2698-4f15-9047-e9b1eb9be371 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.510821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94e645-0d9f-4dc7-a281-309a80f06e8b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.541884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.542535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.542817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.543241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.555929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.557570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.558272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.558967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.570851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:06.571630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:06.579530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:06.580642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:06.581431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:06.584215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 184/366] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:06.585271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.623089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.623993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.625792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.703195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00f420-bb57-4038-9692-ffa58210d37e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.738262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 183/367] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:06.739344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.740581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.741294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.741577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.741852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.742598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:06.742901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.744387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.753180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 185/368] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:06.754038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.800343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.852358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5f57c-981b-4e05-82a4-3f5adf611598 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.856827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:06.872322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40c38b-f276-483d-8d92-e68a0640f826 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:06.894956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.895912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.896332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.896758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.897741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:06.898243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.899808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.909920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 184/369] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:06.910909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:06.913565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88714483-5351-4936-b497-bec81df95378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:06.915252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714483-5351-4936-b497-bec81df95378 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:06.915252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714483-5351-4936-b497-bec81df95378 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:06.915252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714483-5351-4936-b497-bec81df95378 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:06.916257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88714483-5351-4936-b497-bec81df95378 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:06.917739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88714483-5351-4936-b497-bec81df95378 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:06.919482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 186/370] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:06.920366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88714483-5351-4936-b497-bec81df95378 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.019049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa2b-7676-4f2e-af94-e0fca6f3ecea None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.024067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88714483-5351-4936-b497-bec81df95378 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.037703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.059468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.060515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.060989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.061455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.063338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.064014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.064294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.064600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.097744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.138028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.139215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.140136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.140964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.254616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 185/371] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:07.255685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.256947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 187/372] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:07.260330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.285360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.332602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.390021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f19b7-318a-4e62-b0d6-d335e550b3ee None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.399454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140c385-1a7b-420f-bd4a-8fb78ff83a51 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.434374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.435548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.435814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.436096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.440087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.440223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.442902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 188/373] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:07.443846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.446510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.447813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.448285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.448741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.453198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.455053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.457842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 186/374] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:07.459245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.567307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.584013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc33a18-a5e1-4e69-9af3-8d2f4fe20c1c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.585640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f656-a3b7-49ee-ad72-bf57bd0c090b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.613880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.620694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.621548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.621835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.622111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] PATH_INFO: `/v3/projects/a72d8da337ee49b5b2420009a5f9bd45` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.623329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=a72d8da337ee49b5b2420009a5f9bd45)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.624790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.626666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 189/375] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/projects/a72d8da337ee49b5b2420009a5f9bd45 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:07.627909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.630382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.631451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.632013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.632494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.633954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.635715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.637800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 187/376] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:07.643777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.743680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73d734-4d4f-4b31-a637-f4acaeba7ab6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.770314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da91b29-7cc1-4356-bfff-9350063fd573 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.787565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.788663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.789132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.789654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.790670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2cc788345296407ca5b3e77b126f8a56) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:07.791170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.792870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.800255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 190/377] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=b82d7152a4f64644aafded785d073762 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:07.801341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:07.811448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:07.812147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:07.812427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:07.812705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:07.813546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=2cc788345296407ca5b3e77b126f8a56) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:07.813862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:07.815913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:07.823652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 188/378] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:07.905377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:07.957612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5d12-dce1-4269-b2a5-d982b26ae389 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:07.999615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:08.000879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.001366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.001907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] PATH_INFO: `/v3/groups/80374232f07b4394b316686e9b80c10e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.008180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] RBAC: Authorizing `identity:get_group(group_id=80374232f07b4394b316686e9b80c10e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:08.009960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c29afc-7236-43ee-843b-378f71c60964 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:08.012124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 191/379] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:07 2022] GET /identity/v3/groups/80374232f07b4394b316686e9b80c10e => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:08.018192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:08.038383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:08.138226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2e41-ced6-4cbf-9dc1-d3845e019912 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:08.175114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:08.176180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.176662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.177115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.178146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] RBAC: Adding query filter params (group.id=80374232f07b4394b316686e9b80c10e, role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=a72d8da337ee49b5b2420009a5f9bd45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:08.178638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:08.180282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f3995-9945-40a7-afcb-84a94fcc379e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:08.191912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 189/380] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:08 2022] GET /identity/v3/role_assignments?group.id=80374232f07b4394b316686e9b80c10e&scope.project.id=a72d8da337ee49b5b2420009a5f9bd45&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:08.289579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b569-9b26-4673-81bd-dd84a34351ba None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.290209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b569-9b26-4673-81bd-dd84a34351ba None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.290688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b569-9b26-4673-81bd-dd84a34351ba None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.292380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 192/381] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:08.299997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.300628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.301139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.324754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:08.326377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:08.340760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1edf7-078a-4b60-8f08-e8fd2e7a8cc3 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.341095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1edf7-078a-4b60-8f08-e8fd2e7a8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.341314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1edf7-078a-4b60-8f08-e8fd2e7a8cc3 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.342967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 193/382] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:08.353029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.353332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.353590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.381858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:08.383611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:08.435064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 190/383] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:08.462518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:08.467727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 194/384] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:08.476823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:08.494681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:08.593794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:08.624899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddda9d-ccb0-427a-97b5-fea2a79bb654 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:08.677887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737011-ca99-4a4a-97ec-74dcd4b90feb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:08.700946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:08.701666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.701946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.702217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.724603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:08.732267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:08.733148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:08.733961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:08.739927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 191/385] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:08.748623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:08.750760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:08.751591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.752410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.752685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.777186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:08.786875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:08.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:08.790992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 195/386] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:08.798506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:08.887545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:08.917487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b90b56-ed7c-4aeb-9ebc-61c0f43e352f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:08.971435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c58b-701f-44a2-875f-1ad92645cfcd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:08.984529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:08.985192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:08.985470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:08.985743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:08.986529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:08.986901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:08.988388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.003438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 192/387] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:09.009731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.011557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:09.041633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.042295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.042573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.042843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.043612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:09.043919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.047075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.062261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 196/388] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:09.068520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.198423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269b487-7ff0-4a12-869d-915bebc56599 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.246919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:09.253163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.254044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.254324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.254598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.255817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.259527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.265820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 193/389] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:09 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:09.268289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.283754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b387-a9b2-43d2-bbbf-cba34d125a72 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.368221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.369093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.369379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.369657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.374076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077423c0-7c0d-434f-a10a-79166f7ab251 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.376236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.378334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.380392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 197/390] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:09 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:09.385810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.410113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.410993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.411284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.411565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.412864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.414460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.421135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 194/391] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:09 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:09.422463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.490131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:09.498079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:09.526281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372721-2aab-423e-b0c4-2c0c8b8657e0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.546723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164dd8-cd68-4786-b2da-bfd37af90dbe None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.569339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.570231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.570517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.570792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/groups/c2bfaf07ca48445d94e330dda9b91131/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.573001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, group_id=c2bfaf07ca48445d94e330dda9b91131, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.574617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1685934-4b1c-4875-8737-878882c1b6f9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.584611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.585467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.585749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.586022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.587354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.589160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.591296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 198/392] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:09 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:09.598518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:09.603769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 195/393] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 22 05:53:09 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/groups/c2bfaf07ca48445d94e330dda9b91131/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:09.708520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c403a-f0bb-4b3f-96fa-2e8599ac1ddd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:09.743802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:09.749309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:09.750263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:09.750554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:09.750887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/groups/c2bfaf07ca48445d94e330dda9b91131/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:09.753705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b50ba22b40f4c4a862c5d2911b377bb, group_id=c2bfaf07ca48445d94e330dda9b91131, role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:09.755476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b69d6-3768-4066-921f-e16ae559a493 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:09.773320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 199/394] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 22 05:53:09 2022] PUT /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb/groups/c2bfaf07ca48445d94e330dda9b91131/roles/792bbf94ba3642c79d76ead64a6b33be => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:53:10.518801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67db6-cb60-4752-b6c5-38b734136410 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.519287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67db6-cb60-4752-b6c5-38b734136410 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.519287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67db6-cb60-4752-b6c5-38b734136410 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.520897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 196/395] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:10.526420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9de62-6ccb-4491-a908-cfc58107d664 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.526940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9de62-6ccb-4491-a908-cfc58107d664 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.527428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9de62-6ccb-4491-a908-cfc58107d664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.545280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-57a9de62-6ccb-4491-a908-cfc58107d664 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:10.546858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-57a9de62-6ccb-4491-a908-cfc58107d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:10.621993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 200/396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:10.630463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd0f9-10d9-4a6e-a21f-80238c4c7408 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.631025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd0f9-10d9-4a6e-a21f-80238c4c7408 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.631494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd0f9-10d9-4a6e-a21f-80238c4c7408 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.633079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 197/397] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:10.638200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef554-0d66-45df-9656-b8a203899569 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.638725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef554-0d66-45df-9656-b8a203899569 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.639340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef554-0d66-45df-9656-b8a203899569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.659240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-424ef554-0d66-45df-9656-b8a203899569 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:10.660726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-424ef554-0d66-45df-9656-b8a203899569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:10.682604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd0f9-10d9-4a6e-a21f-80238c4c7408 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:10.746738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 201/398] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:10.774050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef554-0d66-45df-9656-b8a203899569 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:10.828313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:10.903963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd0f9-10d9-4a6e-a21f-80238c4c7408 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:10.909736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef554-0d66-45df-9656-b8a203899569 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:10.941524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:10.950136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:10.951298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.951771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:10.952019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.952580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.952704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.952872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.953158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.965620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:10.966915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:10.974414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:10.975394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:10.976221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-9b5a7995-3fc8-49f7-9e70-c5f437b2d7bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:10.976913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:10.977930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:10.979337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 198/399] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:10.984341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8e0a-f998-4fd2-ab34-8b2a8b098285 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:10.984572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 202/400] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:10.984669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8e0a-f998-4fd2-ab34-8b2a8b098285 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:10.985525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8e0a-f998-4fd2-ab34-8b2a8b098285 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:10.987252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 199/401] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:10.989396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:10.991952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd8e0a-f998-4fd2-ab34-8b2a8b098285 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.098153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.105376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ec02-2e58-474c-a8ed-f2f0be93658d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.116463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd8e0a-f998-4fd2-ab34-8b2a8b098285 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.148632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.149421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.149804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.150136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.150962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:11.151339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.153411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e44eb1-5125-459f-9910-5988f2eb6441 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.163699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.164601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.165088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.165754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 203/402] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.166086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.166960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b952f-b458-4760-bcc2-12edc026832b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.167233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:11.167733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.169456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.171675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b952f-b458-4760-bcc2-12edc026832b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.172047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b952f-b458-4760-bcc2-12edc026832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.184917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 200/403] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.184917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.194130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-353b952f-b458-4760-bcc2-12edc026832b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:11.195722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-353b952f-b458-4760-bcc2-12edc026832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:11.254629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.284232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 204/404] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:11.292595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b952f-b458-4760-bcc2-12edc026832b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.341130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caebd2-dfb9-443d-a0e9-4cb836301ea5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.391103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.393386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.393668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.393941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.395147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.396626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.399150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 201/405] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.400417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.413220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.428928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b952f-b458-4760-bcc2-12edc026832b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.469981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.471432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.471831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.472109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.473408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.474949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.477635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 205/406] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.478406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.514134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b2d4-756a-4325-a3e1-3d76d5ab4280 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.534431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.551866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.552664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.552950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.553226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.563872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:11.573435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:11.574337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:11.575116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 202/407] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:11.575844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.589717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f6a5-29ce-44f4-970f-bcadb9ded55f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.624044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.624890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.625167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.625438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.626609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.628114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.630083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 206/408] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.630838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.654637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.679537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146830c0-8b6a-45ee-9de1-247963925161 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.714247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.715104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.715384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.715691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.716871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.718392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.720519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 203/409] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.721279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.730295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664347f-da0b-44e1-a493-1fdff0575673 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.764156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.764816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.765095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.765370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.766108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:11.766410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.768384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.781329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 207/410] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:11.781938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.782209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.826276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378b86-6342-4cdc-bc45-ed6faf0258bb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.863359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.864367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.864684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.865029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/groups/c2bfaf07ca48445d94e330dda9b91131/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.867369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:11.867826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, group_id=c2bfaf07ca48445d94e330dda9b91131, role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.870064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.885315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1b074-48d3-42b5-bc37-1cdb56094b9a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:11.888932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 204/411] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 22 05:53:11 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/groups/c2bfaf07ca48445d94e330dda9b91131/roles/792bbf94ba3642c79d76ead64a6b33be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:11.889961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:11.939757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:11.940818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:11.941100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:11.942482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56/groups/c2bfaf07ca48445d94e330dda9b91131/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:11.947159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cc788345296407ca5b3e77b126f8a56, group_id=c2bfaf07ca48445d94e330dda9b91131, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:11.949739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:11.978035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 208/412] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 22 05:53:11 2022] PUT /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56/groups/c2bfaf07ca48445d94e330dda9b91131/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:12.051672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1897a-0d48-49e5-9ef9-feb541906892 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:12.059921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:12.093705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:12.094574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.094853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.095129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] PATH_INFO: `/v3/groups/80374232f07b4394b316686e9b80c10e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.097949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] RBAC: Authorizing `identity:get_group(group_id=80374232f07b4394b316686e9b80c10e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:12.098106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:12.100116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 205/413] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:11 2022] GET /identity/v3/groups/80374232f07b4394b316686e9b80c10e => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:12.105594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.220694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46336bea-5ea9-4635-9640-2f3042493bd4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:12.260965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:12.261827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.262164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.262432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] PATH_INFO: `/v3/projects/a72d8da337ee49b5b2420009a5f9bd45` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.265247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] RBAC: Authorizing `identity:get_project(project_id=a72d8da337ee49b5b2420009a5f9bd45)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:12.266677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c77b7-04a3-40a1-af66-2c1d5723d3cd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:12.268537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 209/414] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:12 2022] GET /identity/v3/projects/a72d8da337ee49b5b2420009a5f9bd45 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:12.274610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.394657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661b11a-a5ab-490b-9aca-d74199e58c16 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:12.422078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e579d-2e43-48ea-ab4c-203b52c3dc63 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.422407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e579d-2e43-48ea-ab4c-203b52c3dc63 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.422629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e579d-2e43-48ea-ab4c-203b52c3dc63 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.424840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 210/415] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:12.438281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.438701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.439075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.440348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:12.441372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.441819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.442215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] PATH_INFO: `/v3/projects/a72d8da337ee49b5b2420009a5f9bd45/groups/80374232f07b4394b316686e9b80c10e/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.444528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72d8da337ee49b5b2420009a5f9bd45, group_id=80374232f07b4394b316686e9b80c10e, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:12.446162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90d7a4-b6e6-4d2d-a097-4ab380300c30 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:12.467529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 206/416] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Jun 22 05:53:12 2022] PUT /identity/v3/projects/a72d8da337ee49b5b2420009a5f9bd45/groups/80374232f07b4394b316686e9b80c10e/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:12.467529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca923e-806e-4c73-9aa5-44fdd0f494c9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.467529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca923e-806e-4c73-9aa5-44fdd0f494c9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.467529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca923e-806e-4c73-9aa5-44fdd0f494c9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.467529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 207/417] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:12.469277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:12.471303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:12.473053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.473347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.473629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.488234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:12.493194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:12.494431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:12.551126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:12.614942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 211/418] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:12.634418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 208/419] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:12.657337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.681118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.772051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d95f0-82f2-4bb8-9eec-708455f73124 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:12.786014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38840e-dcc3-49ee-947e-f328c4471d96 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:12.810087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:12.811293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.811807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.812261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.823774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:12.828980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:12.830579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:12.831062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:12.831594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:12.831944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:12.832829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:12.833745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 212/420] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:12.842825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.848782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:12.849773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:12.857559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:12.858929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:12.859836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:12.862136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 209/421] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:12.871082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:12.933010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.025124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1a0a-7895-4f06-8c34-8d64170bafcb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.049715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabd3c2-d959-4d6f-bbeb-3d50e0cd2b77 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.068554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.069226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.069499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.069776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.070530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:13.070836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.072256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.101700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 210/422] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:13.107248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:13.112238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.112917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.113205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.113544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.114307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:13.114616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.116038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.125574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 213/423] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:13.130895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:13.205376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.295612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a115-6704-4ecb-b952-c7e9c497e379 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.295842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.325807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb36621-b542-427c-b583-e56937b9239d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.361972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.362783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.363167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.363592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.402046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.402811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.403095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.403373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.457541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.461840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.539258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.541862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.564007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.599328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 214/424] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:53:13.612447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:13.680756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.706812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 211/425] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:53:13.721596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85dd4f-8ad6-4471-84f1-fd50082f2736 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.724862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:13.761285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.762448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.762884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.763337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.764683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.766378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.768320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 215/426] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:13.773483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:13.847956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:13.902897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133ff1-d1e5-421b-a3a0-bf14ade2b5b0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.958129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:13.959989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:13.960621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:13.962202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] PATH_INFO: `/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:13.964576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] RBAC: Authorizing `identity:get_project(project_id=4b50ba22b40f4c4a862c5d2911b377bb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:13.966768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:13.971365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abebea-3705-4917-8830-b5de93b27d55 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:13.973247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 212/427] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/projects/4b50ba22b40f4c4a862c5d2911b377bb => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:13.974587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.032636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.034534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.036812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.037289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.038829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:14.041465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:14.049685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 216/428] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:14.057048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:14.156440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae966-88f3-45d9-91bd-c1ee1c703617 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.229645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.230500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.230777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.231046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.232701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:14.234145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:14.235996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 213/429] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:13 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:14.236879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:14.240664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36e81-aa98-4638-87b2-a39a8c5dc2fe None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.243167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.310830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.312723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.313012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.313291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.314162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=b82d7152a4f64644aafded785d073762, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:14.314477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:14.316031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9878b-3833-4558-9ce7-262223278092 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:14.341924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 217/430] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=b82d7152a4f64644aafded785d073762 => generated 611 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:14.396386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df79974-32b4-42bd-94ff-626cb47d4a7a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.411632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a936-43d2-41ed-8bd1-e76ff8e8a0bd None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.411632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a936-43d2-41ed-8bd1-e76ff8e8a0bd None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.411988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a936-43d2-41ed-8bd1-e76ff8e8a0bd None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.417321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 218/431] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:14.418997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537970-858a-4c92-b8fe-08862c72f24b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.419282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537970-858a-4c92-b8fe-08862c72f24b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.419586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537970-858a-4c92-b8fe-08862c72f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.437959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:14.452327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.453113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.453402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.453683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.454549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:14.454904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:14.456575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4dbe3-cb8e-4349-9c23-b7dd1487bfe2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:14.459695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-80537970-858a-4c92-b8fe-08862c72f24b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:14.460973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-80537970-858a-4c92-b8fe-08862c72f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:14.467864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 214/432] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=4b50ba22b40f4c4a862c5d2911b377bb&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:14.550458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 219/433] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:14.557365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a672b9-f17b-42aa-b45b-332e1a99359d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.557699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a672b9-f17b-42aa-b45b-332e1a99359d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.557924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a672b9-f17b-42aa-b45b-332e1a99359d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.559758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 215/434] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:14.565876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.566179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.566433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.579315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a672b9-f17b-42aa-b45b-332e1a99359d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.589144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:14.590349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:14.674359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 220/435] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:14.700220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.702793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a672b9-f17b-42aa-b45b-332e1a99359d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.729240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:14.750229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.751066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.751350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.751683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.768351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:14.778474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:14.779423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:14.780296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:14.789472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 216/436] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:14.791135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.847969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78db80-3a20-4767-8d97-3b8c74b06d02 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.848781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:14.901857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.902653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.902931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.903205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.920411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:14.929585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:14.930587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 05:53:14.931373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:14.932027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4ce-e76c-4432-9816-cef80b96867d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:14.932099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 221/437] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:14.940040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:14.989699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:14.991381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:14.991698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:14.991975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:14.993887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:14.994200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:14.995623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a07c6-f9bd-448c-a75b-f1e0407b0573 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.006508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 217/438] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.009107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-cceb-4c76-a9b3-9efa1a821c2d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.009571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-cceb-4c76-a9b3-9efa1a821c2d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.010033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223d68-cceb-4c76-a9b3-9efa1a821c2d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.011625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 218/439] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:15.013436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223d68-cceb-4c76-a9b3-9efa1a821c2d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.064481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.091537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da398-1404-4f0d-9923-3a974ce88629 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.155338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.156061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.156401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.158584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.158584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] RBAC: Adding query filter params (name=member) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:15.158584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.160169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850eb09-c64f-4db8-98ae-98cf8ec409ec None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.165975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223d68-cceb-4c76-a9b3-9efa1a821c2d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.172246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 222/440] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:53:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.173820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.173820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.173987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.180074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.197968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:15.199182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:15.222628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.223298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.224386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.224386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.282247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 223/441] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:15.283124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.311078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.312584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.358092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.381995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff141-9ee2-4595-ab56-47e278086e3f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.409788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 219/442] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:15.410615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.416031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.416667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.416944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.417214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.420234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.484491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.485883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.515316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba262-1bd2-41f0-991a-d0039f439a6c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.547881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.549233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.549503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.549767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.558881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.560099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:15.567719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:15.568644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:15.569443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:15.573574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 220/443] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:15.574384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.582410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 224/444] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:15.583222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.642284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.675077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6caff-ca22-4636-afe4-bf2e0a5860f9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.678493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ce3a0-74cc-429e-a32e-63b31c8397dd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.707120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.707985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.708264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.708537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.709685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.710899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.711173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.711570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.711858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.712142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.712874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 221/445] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.712992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:15.713234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.713946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.714855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.724669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 225/446] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.725461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.763325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.814331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cebd8-ec70-4800-8647-ea0dc600ffb6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.823083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89733f-70fb-4465-85f5-d292d2d49d37 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.847335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.848232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.848513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.848797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] PATH_INFO: `/v3/projects/2cc788345296407ca5b3e77b126f8a56` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.849958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] RBAC: Authorizing `identity:get_project(project_id=2cc788345296407ca5b3e77b126f8a56)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.851415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.853122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 222/447] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/projects/2cc788345296407ca5b3e77b126f8a56 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.853875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.860352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.860513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.861379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.861588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.861786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.863003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:15.864450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:15.866065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 226/448] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:15.866793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:15.956433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f79ea-c0f1-4356-b578-0c4043c5ef8b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.962676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329607b4-11a6-4dee-99d0-70c7c559d9dc None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:15.969539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:15.990305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.990939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.991221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.991516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.996260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:15.997082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:15.997362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:15.997634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] PATH_INFO: `/v3/groups/c2bfaf07ca48445d94e330dda9b91131` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:15.998779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bfaf07ca48445d94e330dda9b91131)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.000236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.001830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 227/449] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/groups/c2bfaf07ca48445d94e330dda9b91131 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:16.002573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:16.061066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.062451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.065039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:16.100395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e0dd-ef6a-4fe0-8f1d-cbe9f6c5f2a5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:16.132553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:16.133186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:16.133468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:16.133744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:16.134570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=2cc788345296407ca5b3e77b126f8a56) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:16.134887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.136341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.142669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 228/450] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:16 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:16.143437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:16.167469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 223/451] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:16.173101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:16.203728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:16.279276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688c731-f3a7-4341-8551-48e6a60d56dd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:16.286080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b315-d140-4427-a5a4-1e67f90980f8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:16.288433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:16.327157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:16.328185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:16.328300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:16.328727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:16.329002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:16.329101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:16.329357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:16.329691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] PATH_INFO: `/v3/projects/a72d8da337ee49b5b2420009a5f9bd45` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:16.330411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] RBAC: Adding query filter params (group.id=c2bfaf07ca48445d94e330dda9b91131, role.id=b82d7152a4f64644aafded785d073762, scope.project.id=2cc788345296407ca5b3e77b126f8a56) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:16.330829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.331395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] RBAC: Authorizing `identity:get_project(project_id=a72d8da337ee49b5b2420009a5f9bd45)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.332315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.332852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.335762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 224/452] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:53:16 2022] GET /identity/v3/projects/a72d8da337ee49b5b2420009a5f9bd45 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:16.340245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:16.343547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 229/453] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:16 2022] GET /identity/v3/role_assignments?group.id=c2bfaf07ca48445d94e330dda9b91131&scope.project.id=2cc788345296407ca5b3e77b126f8a56&role.id=b82d7152a4f64644aafded785d073762 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:16.444598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f076b5-0657-4f57-ba5b-a1438269895d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:16.479353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:16.480235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:16.480515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:16.480782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] PATH_INFO: `/v3/groups/80374232f07b4394b316686e9b80c10e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:16.481950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] RBAC: Authorizing `identity:get_group(group_id=80374232f07b4394b316686e9b80c10e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.483398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8d8e8-a204-4fe0-a034-346c4697ef6c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.485037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 225/454] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Jun 22 05:53:16 2022] GET /identity/v3/groups/80374232f07b4394b316686e9b80c10e => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:16.490927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:16.593278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf2f7e-44c3-4ce9-9658-bc9ba2f1a79f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:16.594726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:16.629515 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:16.630155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:16.630432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:16.630702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:16.631549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] RBAC: Adding query filter params (group.id=80374232f07b4394b316686e9b80c10e, role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=a72d8da337ee49b5b2420009a5f9bd45) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:16.631854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:16.633261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76b03-d7ee-4344-9ecf-c3df42809c67 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:16.639185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 230/455] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Jun 22 05:53:16 2022] GET /identity/v3/role_assignments?group.id=80374232f07b4394b316686e9b80c10e&scope.project.id=a72d8da337ee49b5b2420009a5f9bd45&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:19.100121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b119-9859-41e8-b541-7492641dbf6e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.101126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b119-9859-41e8-b541-7492641dbf6e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.101611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b119-9859-41e8-b541-7492641dbf6e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.103422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 226/456] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:19.108783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde73c-6cc6-4908-8c88-5c0c3ef2deba None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.109587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde73c-6cc6-4908-8c88-5c0c3ef2deba None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.110065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbde73c-6cc6-4908-8c88-5c0c3ef2deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.132425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-afbde73c-6cc6-4908-8c88-5c0c3ef2deba None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:19.133618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-afbde73c-6cc6-4908-8c88-5c0c3ef2deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:19.230072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 231/457] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:19.275194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b119-9859-41e8-b541-7492641dbf6e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.345848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:19.410201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b119-9859-41e8-b541-7492641dbf6e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:19.411210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09b92-3818-4ffe-a069-0d35a637c4c9 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.413244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09b92-3818-4ffe-a069-0d35a637c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.415082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09b92-3818-4ffe-a069-0d35a637c4c9 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.417051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 232/458] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:19.418401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d754e6-366f-4a36-bd4a-23c314060b98 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.418877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d754e6-366f-4a36-bd4a-23c314060b98 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.419358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d754e6-366f-4a36-bd4a-23c314060b98 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.421055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 233/459] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:19.426480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.427040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.427556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.444480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:19.446047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:19.446363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:19.447178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.447457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.447781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.459630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:19.461173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3aa8dd1d-353d-4da7-ba77-97063c67a1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:19.482020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:19.482942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:19.483817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:19.483817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:19.483817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.483817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:19.483817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 227/460] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:19.484720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.485150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.485553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.503602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:19.505042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:19.541386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 234/461] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:19.542606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.577165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 228/462] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:19.577881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:19.584652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.621149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:19.683076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02521b-2e57-405f-b0bd-c9004e64cf8e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:19.718452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:19.719382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.719864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.720927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.721821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:19.722300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:19.723942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:19.726154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeec7e2-6e95-49e3-81e0-021ed5a3d9a9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:19.736135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 235/463] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:19.737148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.773245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:19.774873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.775236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.775607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.788719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:19.790721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:19.812934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:19.814182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:19.815185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:19.815185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:19.815185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.815185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:19.817017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 229/464] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:19.820073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.839025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:19.856607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dce9f-d9a2-4886-9b8d-22686ccd3861 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:19.900962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:19.901743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.902460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.902891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.910697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:19.919255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:19.921217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:19.937737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fccef0-7141-445a-9525-cb07c81c2e03 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:19.943699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:19.944789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:19.945852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:19.945852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:19.945852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:19.945852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:19.952548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 236/465] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:19.952548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:19.982914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:19.983886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:19.984330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:19.984762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:19.985761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:19.987459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.012762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 230/466] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:19 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:20.020382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.099396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926648-37e4-4616-b5ce-428360fa2c7e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.154728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.155730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c809-b62a-48e2-be8d-5379024414b1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.157438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.159153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.159736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.160808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:20.161595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.164935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb839ad-ef69-4596-8f85-6be7cef7518b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.176786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.184100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 237/467] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:20.185993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c28-b8f9-4796-bd74-c100849f3a18 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.186844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c28-b8f9-4796-bd74-c100849f3a18 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.187446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22c28-b8f9-4796-bd74-c100849f3a18 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.190006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 238/468] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:20.190902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa22c28-b8f9-4796-bd74-c100849f3a18 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.195492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.205215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.206166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.206532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.207046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.207963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:20.208340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.209809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da9720-5327-4b45-b624-c0a7754a09b1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.233790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 231/469] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:20.234056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.240376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.240376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.253821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:20.254908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:20.332732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa22c28-b8f9-4796-bd74-c100849f3a18 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.339548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 232/470] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:20.339548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.384680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.385104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.385384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.385653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.386349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.387902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.419744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 239/471] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:20.420947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.468669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57702-ddb1-4902-926b-c3462a6e855f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.494200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.503759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.515006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.516065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.516575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.517210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.518268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.519831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c1dab-2d08-4b5f-ad5e-4a423e6cf544 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.545784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 233/472] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:20.547865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82324-b204-45e2-a609-86fee077d608 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.548770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82324-b204-45e2-a609-86fee077d608 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.549087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82324-b204-45e2-a609-86fee077d608 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.555372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 234/473] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:20.557611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.557897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.558175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.568641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467f028-42c6-4b4d-8fd6-0e82cf7d7d37 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.584495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:20.586018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:20.627021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.628065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.628345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.629984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.654439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.657178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.682984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 235/474] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:20.687943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:20.688876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:20.689718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:20.689718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:20.689718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:20.689718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.691083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 240/475] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:20.700664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.705649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.849247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69910189-8ef1-4f05-94db-de1828d5d574 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.859358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036ccb-56cd-4507-aea9-7afae25646b9 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:20.860838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.872416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:20.896294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.897382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.897734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.898076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.899153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:20.899545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.901515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.906980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:20.908458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:20.908920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:20.909386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:20.910897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:20.913303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:20.915185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 236/476] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:20.921118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:20.925974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.sql.core [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 05:53:20.925974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 05:53:20.925974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [parameters: {'id': '0188013afdee4d2c9f495a9c9ee2327a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 05:53:20.925974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79995) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result.read() Jun 22 05:53:20.947750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:53:20.948694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application yield resource Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise self.value Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application session.commit() Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 05:53:20.949600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.session.flush() Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application compat.raise_( Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 05:53:20.950549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:53:20.951430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result.read() Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:53:20.952284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [parameters: {'id': '0188013afdee4d2c9f495a9c9ee2327a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:20.953065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 05:53:20.953869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:20.954773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 241/477] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:20.968612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:21.053497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6f26-e302-4962-971d-d1d0c84120f4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:21.090644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:21.091712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:21.092212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:21.092680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:21.093636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:21.095906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:21.134121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 237/478] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:20 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:53:21.165947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2441-8f8c-4d0b-9eeb-3caed88744b2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:21.226156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:21.227365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:21.227902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:21.228385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:21.246336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-18c52c66-eb50-4db0-ac9e-cbc1e05027cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:21.255402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:21.256358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 05:53:21.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:21.267567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 242/479] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:21.273615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:21.304162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:21.386571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8648-b797-478b-8825-e4732489b8e2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:21.422027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:21.423114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:21.423684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:21.424183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:21.425146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:21.425650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:21.427256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f514b-3351-4c55-888f-74be8f317852 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:21.436608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 238/480] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:22.425577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200dd82-17b3-41e9-a6f0-28a66197b8b4 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:22.426081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200dd82-17b3-41e9-a6f0-28a66197b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:22.426189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200dd82-17b3-41e9-a6f0-28a66197b8b4 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:22.427861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 243/481] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:22.433337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:22.433741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:22.433908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:22.456525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:22.457723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:22.557510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 239/482] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:22.600981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200dd82-17b3-41e9-a6f0-28a66197b8b4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:22.649885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:22.747259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200dd82-17b3-41e9-a6f0-28a66197b8b4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:22.799351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:22.800183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:22.800463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:22.800734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:22.818019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:22.825647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:22.826544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:22.827970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 244/483] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:22.834768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:22.868613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.022266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0daba4-c01d-4c00-a39a-bffc2ec236cd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.073606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.074188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.074468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.074742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.075487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:23.075811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.077172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52cd8-a529-41f3-9455-184605ee6842 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.090855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 240/484] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:23.096684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.165383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dac6b-ee46-4433-b758-fe077b9f90db None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.165694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dac6b-ee46-4433-b758-fe077b9f90db None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.165965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dac6b-ee46-4433-b758-fe077b9f90db None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.167601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 241/485] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:23.172129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.172404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.172684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.205044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:23.206219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:23.215519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadd76-d984-4a12-a00d-3eab889eceec None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.239921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.260016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.260799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.261079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.261353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.272726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.274179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-5d8e085e-6f2b-4c2e-8500-c9089960e6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:23.291048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:23.291950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:23.293219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:23.293219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:23.293219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:23.293219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:23.293219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 245/486] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:23.293869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c396fd-5b02-4104-92cb-b277fb93ff69 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.294157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c396fd-5b02-4104-92cb-b277fb93ff69 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.294390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 242/487] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:23.294490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c396fd-5b02-4104-92cb-b277fb93ff69 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.300752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 246/488] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:23.301434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.305941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.306444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.306910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.313329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.330479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:23.331979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:23.404392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 247/489] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:23.405615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.433750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd1c8-167c-4af3-b30a-bd4b602d2b04 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.472077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.472971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.473471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.473881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.474865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:23.475321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.476868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.478508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.492392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 243/490] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:23.493489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.517882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17999c50-8608-42e2-a8ca-ee00cbf27f8b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.553451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.554338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.554837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.555306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.563942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.566805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:23.574771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:23.576245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:23.577043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:23.579488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 248/491] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:23.580734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.599222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c7cf-60ca-40eb-8463-070e119b0b2c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.635400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.636350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.636632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.636904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.647813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:23.655895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:23.656984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:23.658449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:23.665239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 244/492] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:23.666471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.685882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fc09d-b8a4-4892-9e1e-caf06c3f949c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.716922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.722693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.723680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.724103 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.724540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.733667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.735377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:23.751870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:23.752980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:23.753981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:23.760476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 249/493] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:23.761545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.772892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ae852-8f92-4684-998b-3e344ab8978b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.801388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:23.809994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.810668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.810954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.811234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.812121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:23.812431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.813829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.822889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 245/494] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:23.823730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.872769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36157c-ac5b-4679-92ce-1c381d16da9b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.908941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.909836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.910258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.910704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.911690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:23.911994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.913362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.926769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 250/495] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:23.926769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:23.939170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b0e0-5e60-497a-80d5-7271635b5dfd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:23.975558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:23.976183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:23.976467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:23.976755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:23.977584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:23.977891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:23.979335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f37a94-c0a3-411f-8cfb-aa11960e6f54 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:23.983758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.015470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 246/496] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:24.016832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cb63c-027a-4503-b8e9-93bc511cfe55 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.017121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cb63c-027a-4503-b8e9-93bc511cfe55 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.017400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cb63c-027a-4503-b8e9-93bc511cfe55 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.021383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 247/497] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:24.021383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cb63c-027a-4503-b8e9-93bc511cfe55 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.036285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999dda4-14cc-4aea-9d23-b3d38d6249bd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.068813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.071907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.072703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.072970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.073247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.084042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.085472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:24.102613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.103681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 251/498] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.104726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.124128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cb63c-027a-4503-b8e9-93bc511cfe55 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.156886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.158271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.158552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.158829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.168420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.169861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5468eca2-4512-4115-a399-bbee02f1b3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:24.186682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.187551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.188404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:24.188404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:24.188404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.188404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:24.188404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 248/499] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.189182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c65b-19be-4340-a78b-cb508c8a78e9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.189470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c65b-19be-4340-a78b-cb508c8a78e9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.189745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c65b-19be-4340-a78b-cb508c8a78e9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.191009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 249/500] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:24.192072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.192647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.192803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.207056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6014-64ea-4079-8461-7035d55c6e8b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.209332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:24.210508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:24.219914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.246268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.246909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.247196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.247470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.277383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 250/501] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:24.278216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.315419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.315604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.316949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.389535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e61d75-0407-41b0-9350-63d20d19119f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.415321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 252/502] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:24.416184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.423943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.427454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.428210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.428493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.428766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.429489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:24.429795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.431182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23460d-5b61-4fa7-9e19-2cd00cada9da None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.442631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 251/503] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:24.443921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.444293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.444574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.461736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:24.462919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:24.514253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd871b-4f36-42a2-ae9c-e95050454999 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.527893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 252/504] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:24.528812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.546254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.550913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.551599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.551887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.552161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.552880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:24.553181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.554552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.566140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 253/505] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:24.566917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.629012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08a76-7d5e-400e-8772-597062a9a3f6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.629426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.661756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.662466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.662772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.663044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.663829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c225d6-a15c-40f8-865a-9bd801f2df51 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.672864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:24.680504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.681425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:24.682222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 253/506] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.682890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.700994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.701769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.702052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.702329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.713207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.714895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:24.731806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.732662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.733497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:24.733497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:24.733497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.733497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:24.733497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 254/507] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.733765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.763003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.785246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52bb41-0564-45b2-9c60-d268259c32a5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.818883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.819697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.819986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.820266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.828062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.830042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.839769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb706-a8d6-4836-85d8-301c391d504c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:24.845961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.847044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 254/508] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.852885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.857710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:24.874187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.874962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.875243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.875541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.885714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.887144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:24.904065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:24.904935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:24.905793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:24.905793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:24.905793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:24.905793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:24.905793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 255/509] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:24.906076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:24.950803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af885-cecd-4483-83f8-c055d3fca199 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:24.984958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:24.986074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:24.986511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:24.986790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] PATH_INFO: `/v3/users/glance` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:24.994214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:24.995689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:24.997385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.006566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50bc49-80e9-4b7b-8be3-9a5b7de6b180 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:25.010586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:25.011647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 255/510] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:25.012533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.043613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.044376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.044695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.045011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.045971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.046289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.047771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.055760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 256/511] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.056454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.086829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.116577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34feb6-3798-47df-8072-0b51eeae833a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.148735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.149382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.149667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.150015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.150730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.151035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.152450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.153800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70c9b7-bf8c-4f64-8f56-ea5a7ddd6ad2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.164434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 256/512] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.165124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.188096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.189261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.189545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.189822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.190654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.190962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.192414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.223575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.231481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 257/513] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.236746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.265582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fece47-8fbf-4308-b148-e4fe2962e9db None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.298154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.298799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.299078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.299348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.300099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.300398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.301761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.312394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 257/514] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.313177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.324509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.335425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21df087-9940-4bea-96b0-b7406ecd1151 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.368372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.369024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.369303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.369574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.370390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.370695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.372156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.389069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 258/515] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.389869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.414155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf338-2f7a-46f0-8598-87ba43bf03b6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.430293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.447566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.448350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.448635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.448912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.459668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.461128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:25.477793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:25.478780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 258/516] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:25.484447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.486486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a567-4fd3-40a9-bf1b-0340601795c2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.521111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20944868-c61b-4875-9e59-175265157713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.521888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944868-c61b-4875-9e59-175265157713 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.522169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944868-c61b-4875-9e59-175265157713 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.522439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20944868-c61b-4875-9e59-175265157713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.528995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20944868-c61b-4875-9e59-175265157713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.530432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20944868-c61b-4875-9e59-175265157713 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-20944868-c61b-4875-9e59-175265157713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:25.544433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:25.545291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:25.546168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 259/517] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:25.546633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20944868-c61b-4875-9e59-175265157713 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.558108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.584505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033d0d5-6ca4-4b91-905b-6db5a6bacbf0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.617184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.617816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.618098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.618367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.645113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20944868-c61b-4875-9e59-175265157713 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.655828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.678263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.678915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.679193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.679466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.680182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.681609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.684540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.685996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.702026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 260/518] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:25 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:25.702606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.779301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.800147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 259/519] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:25.800147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:25.829801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f9153-e17e-4ad1-80ee-fabe5affad86 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.867840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.868488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.868771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.869050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.875267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:25.924964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4935-c2e6-4889-a647-e594476b0d77 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:25.945395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.947043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.958034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:25.958697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:25.958980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:25.959263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:25.960015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:25.960323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:25.961691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:25.973814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 260/520] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:25.978793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.011890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.054169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 261/521] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:26.054936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.085968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae677f1-a7b7-453d-b67a-5d676b785fc1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.114531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.121340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.121991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.122268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.122540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.123313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:26.123647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.125080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.146696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 261/522] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:26.146696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.165234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c66ee4-0f4d-413a-81c4-50dfad9d133d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.201316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.202152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.202436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.202710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.215234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.216732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:26.239609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:26.240467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:26.241305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:26.241305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:26.241305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:26.241305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:26.241305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 262/523] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:26.241561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.256814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780718c6-d86d-46cd-b95e-eed0cd63bf6a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.259962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.292644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.293436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.293726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.293984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.301794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.303237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:26.317707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:26.318621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:26.319946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 262/524] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:26.324243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.347223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765ab80-e70f-41ca-8d5d-bd7903048db0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.377227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.382762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.383566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.383856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.384136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.395092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.397070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:26.415757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:26.416738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:26.417596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:26.417596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:26.417596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:26.417596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:26.417596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 263/525] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:26.417881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.439729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9e599-73c3-4826-bd02-3509b2c28f0f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.482068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.482888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.483017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.483263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.484144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:26.484451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.485933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.488682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.499547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 263/526] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:26.499547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.542813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9bdb-8f4b-4b51-bbad-9e42b025310c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.593450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.594428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.595669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.596098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.597473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:26.597959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.599658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.615731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 264/527] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:26.616748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.617717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aad32-bcd7-4ead-9409-aa5081c41a47 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.633747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.659681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.660647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.661080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.661505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.662675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:26.663210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.664970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.689118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 264/528] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:26.690229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.728011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8b344-5374-4421-9d39-b8536212b620 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.760088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.770157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.770842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.771291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.771477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.772340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:26.772540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.773913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.792089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 265/529] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:26.792973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.794359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3628ee-941a-485f-8279-09292dad6edb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.833483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.834629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.835179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.835631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:26.843146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:26.845634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:26.862097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:26.863203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:26.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:26.866258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 265/530] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:26.867349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:26.906494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:26.908593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909a24c-9e32-41a6-8f3e-0bcb8b9a5051 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:26.943306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:26.944009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:26.944292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:26.944574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.003584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.003867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4365-8588-4b97-826f-ada786f398d6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.018933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.020426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.050731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.052086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.052757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.053626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.062804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.065037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:27.086079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:27.086968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:27.087864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:27.091139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 266/531] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:27.092154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.136880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 266/532] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:27.136880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.213877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.225698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de864cc8-ef80-4035-9e8d-5c6b5ea449d8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.229639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.243002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedabc09-f3a5-4abc-aa08-c47aecd37d5b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.275259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.276309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.276810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.277411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.278448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:27.278611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.279059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.279439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.279843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.280224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.281095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:27.281387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.281582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.283727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.295960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 267/533] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:27.296987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.306545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 267/534] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:27.310018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.408096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456e8a-147e-4962-965a-37e2e271242c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.445957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.446987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.447102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69db8-aee2-413b-802d-b47897d1e15c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.447533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.447979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.463710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.465755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.483359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.484232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.484607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.484974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.485986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=47e0e69820cb4c269c1d6043d70380f2) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:27.486395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.487952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:27.489341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:27.490667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:27.491758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:27.491758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:27.491758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:27.491758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:27.498534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 268/535] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:27.498534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.502295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 268/536] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/role_assignments?user.id=47e0e69820cb4c269c1d6043d70380f2&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:27.503326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.509367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.527958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.636711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1a58-1184-41ff-a319-9629908eca56 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.681443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.682661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.683160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.683820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.684781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:27.685294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.687355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.705452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 269/537] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:27.711032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:27.773646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470def-6dd1-48f9-bf74-0de4b5085f8f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.794620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:27.828431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3e44-72ed-49d9-8421-72ac1f89b4cb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:27.863413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.864088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.864371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.864646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.865477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=3c6d629e689d45d4b28b24b7f3d0d3d8) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:27.865788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.867231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558809-ebe7-4308-b85d-d22ab532a640 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.879474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 269/538] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/role_assignments?user.id=3c6d629e689d45d4b28b24b7f3d0d3d8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:27.884119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14acd2-db78-485e-8c21-888b6a2ca28e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.884405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14acd2-db78-485e-8c21-888b6a2ca28e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.884686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14acd2-db78-485e-8c21-888b6a2ca28e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.885153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:27.885954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.886289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.886402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 270/539] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:27.886576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.896245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:27.897012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:27.897012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:27.903732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:27.905224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:27.930891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:27.931927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:27.932790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 270/540] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:27.936463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:27.937848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:27.941118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.022151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:28.032085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 271/541] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:28.059025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.127285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa66a6-12e3-4647-affe-ab256271ba10 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.160823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:28.169572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:28.171407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.171787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.172071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.175844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:28.176177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:28.179808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:28.207199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 271/542] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:28.214818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.273635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a724f-5254-4fa5-9431-0922cf5b47de None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.341076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e2a53-306e-4a12-8c15-530f807addd4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.368211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:28.369010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.369287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.369556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.382017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:28.382661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.382939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.383211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.384069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1d7e8acb91804c358b40c90faa233296) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:28.384377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:28.385798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:28.393916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:28.401570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 272/543] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/role_assignments?user.id=1d7e8acb91804c358b40c90faa233296&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:28.406793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:28.407781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:28.408573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:28.413142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 272/544] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:28.414635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.489162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:28.534211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd445049-e349-464d-b8ca-582437a2870c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.571133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:28.571826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.572108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.572381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.573125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:28.573425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:28.574806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b0c49-e731-4599-bf40-9580987ec959 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:28.587633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 273/545] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:28.589882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.653698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:28.700344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c72fc-8102-4e9f-8325-cb03c149d520 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.737713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:28.738856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.739394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.739866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.760512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:28.762278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:28.769937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f925ea-d9b6-460f-83b2-4a608f74c773 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.770464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f925ea-d9b6-460f-83b2-4a608f74c773 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.770734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f925ea-d9b6-460f-83b2-4a608f74c773 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.772600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 274/546] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:28.778561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:28.778843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:28.779116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:28.785004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:28.786020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:28.787079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:28.787079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:28.787079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:28.787079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:28.788963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 273/547] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:28.802026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.807919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:28.809096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:28.917389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 275/548] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:28.952354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:28.957928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c92d9-c92b-4cfa-b687-5eca2a8b2375 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:28.978935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.024553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.025143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.025425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.025700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.026411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:29.026712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.028116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.044726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.046019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 274/549] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:29.059554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.105052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bf359-44f9-4c3f-921b-276704f48599 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.139595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.140399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.140686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.140969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.152155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:29.159847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:29.161241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:29.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 276/550] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:29.170436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.245018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81aa3-ad0d-41eb-a3c2-51b76c0a19e1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.307626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.308392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.308681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.308957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.320917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.322391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.351286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef08bb-f931-40dc-b74f-b8d0b815a6a1 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:29.355273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:29.356229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:29.357295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:29.361233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 275/551] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:29.367768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.372009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.418724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.424703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.425383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.425670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.425949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.426708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:29.427019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.428514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.441081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 277/552] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:29.448952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.496482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380b2c6-06b6-4c24-b4b9-f3c2964a3b21 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.558702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.559289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.559598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.562232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.563095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:29.564022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.565465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.572675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245990-1fb0-4eec-afba-3905384d06ba None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.602560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 276/553] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:29.608223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.636278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.637071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.637354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.637630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.648890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.650359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:29.668730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:29.670796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:29.673456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:29.673456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:29.673456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:29.673456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:29.673456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 278/554] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:29.679252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:29.723846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.761224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:29.775245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff141cf-ec8f-46c2-889c-114fdf585a13 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.818029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.819828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.819828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.819828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.897959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.899331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490e2a2-1c4e-4866-8fc1-ebabb92c13a1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.914302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6632ce-3292-43fc-a859-d3299e1e4461 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:29.988142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:29.989160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:29.989643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:29.990146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:29.991063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:29.991616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:29.993182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79e954-1294-4d33-9a09-ac989fa2bf89 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:29.998510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.006597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 279/555] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:30.008834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352028d-d800-4fa3-8e4b-3da4f7497ed6 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.009350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352028d-d800-4fa3-8e4b-3da4f7497ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.009825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352028d-d800-4fa3-8e4b-3da4f7497ed6 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.017258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 280/556] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:30.017258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352028d-d800-4fa3-8e4b-3da4f7497ed6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.025082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 277/557] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 05:53:30.026614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.027286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.027822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.046698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:30.049153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:30.123823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.135769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 278/558] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:30.137568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.145464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352028d-d800-4fa3-8e4b-3da4f7497ed6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.188704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.189495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.193225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.193225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.205285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.207578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:30.225458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.226836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:30.227788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:30.231578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 281/559] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.232646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.285041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe8b63-ee87-4451-9b0c-e04ea2c2d97c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.304928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.323272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.324103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.324382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.324657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.336450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.338458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:30.357283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.358301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 279/560] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.359803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.373145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb438c5-8423-421f-b17a-a265f7e57c6c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.413994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.414703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.414984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.415258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.425368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:30.433146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.434264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:30.435332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 282/561] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.436172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.439033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.477953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183982-aadf-4920-9edb-c2ba21448384 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.515776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.517218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.517653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.518105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.519225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:30.519558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.521344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94827-bebb-43ba-9967-ba4294498ab7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.542315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 280/562] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:30.546654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c07b0-9a58-440f-95ea-cfa3bdcf2f61 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.548083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6194-9208-4360-9257-9821501dcfd3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.548290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6194-9208-4360-9257-9821501dcfd3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.548539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d6194-9208-4360-9257-9821501dcfd3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.553907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 281/563] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:30.553907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d6194-9208-4360-9257-9821501dcfd3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.587979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.593454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.594116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.594421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.594706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.595429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:30.595764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.597133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.608900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 283/564] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:30.609691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.673683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.676067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d6194-9208-4360-9257-9821501dcfd3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.712165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.712891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.713451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.713741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.714488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:30.714795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.716205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7112e-deaf-419a-9b88-b71c0d1c3253 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.717188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5f2f0-3c48-403b-9737-6777ce97a7ac None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.724429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 282/565] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:30.725716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.726012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.726290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.746116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:30.747305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:30.760022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.760807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.761089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.761363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.772189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.773623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:30.790518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.791590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 284/566] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.797392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.814940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 283/567] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:30.815801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.838079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.898949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc049-d321-4816-b792-f112c510dbd2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.913005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:30.920636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3e56-dd40-4f78-b306-5e524243638c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:30.934230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.934947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.935225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.935495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.942684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.944151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.954898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:30.955698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.955982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.956253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-cf6ae88e-6a70-4d6d-8229-832a2fd38a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:30.957404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.958407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:30.959480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 285/568] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.960096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004cb5-ea21-4a44-a9ca-6a5ea2a4985f None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:30.960308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004cb5-ea21-4a44-a9ca-6a5ea2a4985f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:30.960582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c004cb5-ea21-4a44-a9ca-6a5ea2a4985f None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:30.961950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 286/569] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:30.966631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004cb5-ea21-4a44-a9ca-6a5ea2a4985f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:30.969256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:30.971779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:30.990922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:30.991853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:30.992727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:30.992727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:30.992727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:30.992727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:30.992727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 284/570] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:30.993019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.060523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.071020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c004cb5-ea21-4a44-a9ca-6a5ea2a4985f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.090467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3335c6-ed9a-46fe-b5f3-2dcb36e48bcb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.104420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.105066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.105348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.105620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.106337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.106640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.108048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.119768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 287/571] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.120541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.123457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.124258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.124537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.124808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.135278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-eca24076-0639-4bf1-bfc5-9e0adfbf35a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:31.142853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:31.143964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:31.144908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 285/572] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:31.145619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.145619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.145859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.159883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.162242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:31.163925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:31.227149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dbc99-5742-4054-b204-19357bbf3157 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.229149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 286/573] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:31.229973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.263839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.264496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.264777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.265051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.265827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.266135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.267579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.278663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 288/574] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.279439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.293649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.330765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54c0eb-ab99-4fbe-9f8f-9b8b607ef11c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.364552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.365200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.365485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.365768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.366479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.366783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.368171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.371460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.378219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca751-3d8f-441d-929f-21a503c0580c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.379723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 287/575] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.380515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.411612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.412465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.412817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.413162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.419757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.421197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:31.435556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:31.436591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 289/576] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:31.437666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.479464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8be8b-0147-4aa9-a37d-6c12b3c508a2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.501370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.512948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.513605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.513895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.514174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.514917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.515226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.516663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.524374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 288/577] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.525138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.536383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcad43-6508-4e86-b9ee-133b877068d2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.570620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.571384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.571691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.571965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.582405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:31.590356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:31.591333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:31.592215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 290/578] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:31.592915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.608066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.625356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70edd0-422a-4697-8cbe-7641783157bd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.656966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.658135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.658417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.658695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.659540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=4d8b3103a87541c7ae82ca280985f174) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.659851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.661289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.666542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 289/579] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/role_assignments?user.id=4d8b3103a87541c7ae82ca280985f174&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.667299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.700876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcc849-03b5-4656-b545-c32383c113d1 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.732281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.740061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.740859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.741145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.741410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.750135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.751828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:31.767262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:31.768432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 291/580] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:31.769386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.794412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acc974-a151-49c3-a8ab-ea9b3345729a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.832843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.833737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.834555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.834983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.836298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.836894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.839383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.852760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 290/581] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:31.853660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.863142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.888928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3178bfb-6e13-41ec-b070-edae962bb176 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.925496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.926652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.926652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.926883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.937479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.939472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:31.957545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17761-15dc-4a82-8e74-11c13f38c2db None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:31.958737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:31.959791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:31.960697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:31.960697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:31.960697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:31.960697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:31.967272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 292/582] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:31.967272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:31.967840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:31.995245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:31.995860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:31.996144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:31.996421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:31.997167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:31.997476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:31.998844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.013009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 291/583] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.013009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.073487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727295-0d16-44fd-92ae-44ac3b4a51b8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.100645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.110589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.111410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.111834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.112198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.113125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:32.113534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.115046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.120246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a43ffc-f9cd-44c8-926f-2aa6193559a7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.137850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 293/584] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.137850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.169752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.170654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.170970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.171220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.190670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=217be31925ad4d859522dce86af2ca45, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.192873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.209051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 292/585] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:32 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:32.210076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.253965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.278875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4bbb-3bd3-4897-a47e-742fc986540c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.328078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.328754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.329450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.329744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.330487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:32.331126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.332912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.349990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 294/586] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.351527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.359050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4281-6d8a-4aa2-aebe-d181d116ba16 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.405103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.406048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.406338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.406612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.411978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.418832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.420326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:32.440497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:32.441423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:32.442298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:32.442298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:32.442298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:32.442298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:32.442298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 293/587] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:32.443138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.489132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd617-8ac3-4a85-bac8-22c18d15c6e9 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.532634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.533788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.534277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.534755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.538893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.546146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.548654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:32.568210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:32.569146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:32.570036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:32.570036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:32.570036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:32.570036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:32.576488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b263-7c12-46f1-a909-1bdab2639fa9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.576758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 295/588] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:32.577811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.615432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481870be-6850-4757-8802-566564f493c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.615981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481870be-6850-4757-8802-566564f493c9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.616266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481870be-6850-4757-8802-566564f493c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.616545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481870be-6850-4757-8802-566564f493c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.624592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481870be-6850-4757-8802-566564f493c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.626636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481870be-6850-4757-8802-566564f493c9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-481870be-6850-4757-8802-566564f493c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:32.642838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:32.643856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:32.644788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 294/589] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:32.645474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481870be-6850-4757-8802-566564f493c9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.682854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.689177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0013-35f4-4297-a6d4-96cdbe629052 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.725055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.726097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.726596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.727075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.728046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:32.728572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.730132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.744759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 296/590] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.745959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.755664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481870be-6850-4757-8802-566564f493c9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.790863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.794459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.795108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.795393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.795760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.796529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:32.796840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.799292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.815763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 295/591] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.815763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.859097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995786a-53f6-4022-a4d3-eaa601fe62be None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.895819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.896950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.897463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.898417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.899846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:32.900378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.902077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:32.920994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 297/592] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:32.921691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4683-ae98-478b-9048-67172f02b28d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:32.922420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:32.939332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:32.967365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:32.968194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:32.968479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:32.968759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:32.979765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:32.981221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:33.002151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:33.003146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:33.004534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 296/593] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:33.005123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.036274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9b1b-ce31-4c11-a261-a842314ad549 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.075941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.085278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.086060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.086343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.086618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.101771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.103489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:33.121988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:33.122868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:33.124228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:33.129793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 298/594] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:33.129793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.142300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5185ba-c65c-4b2f-91da-5b9feaea6642 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.188146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.189548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.190428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.191161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.205943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.208921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.224917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:33.234994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:33.235903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:33.236776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:33.236776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:33.236776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:33.236776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:33.239055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 297/595] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:33.240527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.259788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22020-1a36-4dd2-ae1e-3a784f660546 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.306962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.307887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.308337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.308759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.309973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:33.310423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.312872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.341615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 299/596] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:33.342689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.349755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8614b9-f297-47d3-9f1e-5aa30595a71f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.352509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.386858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.387814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.388123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.388546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.389429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:33.389884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.391963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.411137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 298/597] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:33.411137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.456628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb606-4615-4129-a10a-24565fe66d57 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.487297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.492672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.493578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.494067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.494555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.495461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:33.496059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.498033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.510883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 300/598] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:33.511965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.519467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b49f-c1fa-4ab1-93f1-1e8614b74464 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.555051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.555866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.556151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.556591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.570276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.571800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:33.595693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:33.596606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:33.597510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:33.597510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:33.597510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:33.597510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:33.601313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 299/599] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:33.602254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.620760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.625258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f1be-a3e8-409d-8675-cf922ac4753e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.661854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.663077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.663587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.664095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/47e0e69820cb4c269c1d6043d70380f2/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.679914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=47e0e69820cb4c269c1d6043d70380f2, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.681619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.707624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 301/600] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:33 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/47e0e69820cb4c269c1d6043d70380f2/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:33.708949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.713003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85bdfc-406a-4c15-8cae-1e0235aec94b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.764791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.765606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.765856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.766128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.776277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.778228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.778905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-05feea61-a318-4f68-ba23-e39b44a692af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:33.796496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:33.798083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:33.798978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:33.803693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 300/601] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:33.805520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330031-3fec-4e47-9c76-a82d0e6878c4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.805806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330031-3fec-4e47-9c76-a82d0e6878c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.806082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330031-3fec-4e47-9c76-a82d0e6878c4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.808410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 301/602] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:33.811678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330031-3fec-4e47-9c76-a82d0e6878c4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:33.871634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63136-d330-4d7f-97d0-092eb0850e5e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.911574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:33.921591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:33.921792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.921987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.922250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.923523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:33.923831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:33.925184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedafdf-c977-4d62-a091-1a06afb01b96 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:33.936851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 302/603] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:33.937926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:33.938767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:33.939053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:33.951749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330031-3fec-4e47-9c76-a82d0e6878c4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:33.959994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:33.961228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:33.998963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.000036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.000475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.001452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.002518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:34.002980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.005814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.020878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 302/604] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:34.025573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.050157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 303/605] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:34.051958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.105777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.154749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d5b4-d7fd-416b-bc47-802df11eadba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.191704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.192857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.193346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.193848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.197332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.200030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e432b2-4d56-4b47-b8fc-fc816bab00e1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.202783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.205197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:34.226251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:34.227114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:34.228361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:34.230297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 303/606] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:34.231351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.241123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.242561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.242844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.243115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/3c6d629e689d45d4b28b24b7f3d0d3d8/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.260573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=3c6d629e689d45d4b28b24b7f3d0d3d8, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.262432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.288161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 304/607] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:34 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/3c6d629e689d45d4b28b24b7f3d0d3d8/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:34.288161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.409470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06ef2-90e1-410d-98dc-a074dfc44694 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.441639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.456365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.457220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.457509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.457785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.465397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640b4-130f-4071-b6a4-dc9a9b22aa9b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.472185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0f44b747-8700-4c55-9e11-92693829d545 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:34.480254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:34.481418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:34.482436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 304/608] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:34.483365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba856b-f542-455b-81df-892c0f409a38 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.483365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba856b-f542-455b-81df-892c0f409a38 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.483865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba856b-f542-455b-81df-892c0f409a38 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.485656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 305/609] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:34.491095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428484-433d-4477-933f-1baf21916b78 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.491385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428484-433d-4477-933f-1baf21916b78 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.491697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428484-433d-4477-933f-1baf21916b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.513687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-54428484-433d-4477-933f-1baf21916b78 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:34.514897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-54428484-433d-4477-933f-1baf21916b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:34.520832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.521672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.522180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.522596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.524070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:34.524543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.526988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.544055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 305/610] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:34.545525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.581731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.608694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 306/611] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:34.609738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428484-433d-4477-933f-1baf21916b78 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.678186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd31a72-44dc-45ad-91f8-be0eebcf4081 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.713835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.714584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.714939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.715286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.716146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:34.716518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.717963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.731559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 306/612] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:34.731559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.737265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.742999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428484-433d-4477-933f-1baf21916b78 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.790306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.791228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.791534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.791820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/1d7e8acb91804c358b40c90faa233296/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.811363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=1d7e8acb91804c358b40c90faa233296, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:34.813168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:34.835028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 307/613] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:34 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/1d7e8acb91804c358b40c90faa233296/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:34.836158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:34.868388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb41b-cd64-4735-8d49-4b18d60c5ef5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:34.894640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:34.915220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:34.917518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:34.919843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:34.921267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:34.945775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:34.957160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:34.958227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:34.959088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:34.968232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 307/614] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:34.976323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.033890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab52fc-f0cc-44ed-869b-a2038fc5abce None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.066732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:35.074154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.074957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.075259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.075610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.089731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.091199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:35.109694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:35.110675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:35.111610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:35.111610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:35.111610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:35.111610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:35.111610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 308/615] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:35.116683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.121320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99c53-3260-4485-91b8-bf8df4545bb8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.184873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.185535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.185816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.186152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.186905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:35.187260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.189181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.203224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 308/616] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:35.209194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.264470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:35.293909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa4f2-9fb7-4f23-b152-99c0f4832a62 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.355334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.355875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.356206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.356487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.357212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:35.357517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.358889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.385391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 309/617] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:35.386636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.403556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288c3e7-4af6-4c0b-aa5e-6e38a9bd86fd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.445720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:35.465974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.466730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.467016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.467291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.484746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.486731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:35.522150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:35.523097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:35.524022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:35.524022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:35.524022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:35.524022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:35.524022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 309/618] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:35.532547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.551448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cbf3-5844-469a-9252-9dfb193102e7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.587970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.589593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.590072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.590585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.602884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.604918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:35.621276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:35.622343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:35.623429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:35.626754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 310/619] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:35.633526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.647234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:35.704849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa376ad2-c41a-4c90-aca5-9c828fbc4218 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.740595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.741280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.741570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.742015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.742669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:35.742982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.744369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.757300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 310/620] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:35.766035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.808118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:35.867682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f6bab-2315-4a3b-8ec8-90bb2d8e56e5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.876123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8596b-8878-4eff-866d-aeb09202fe92 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:35.915457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.916252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.916561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.916801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.917731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:35.918719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:35.919203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:35.919770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:35.920815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:35.921327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.923092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.924164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:35.925717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:35.941026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:35.942073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:35.943095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 311/621] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:35.945116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 311/622] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:35.948456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:35.950305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.065243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.099162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.103051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10f0c6-4fe8-4095-bed8-f2583ebf9872 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.105170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d42f-1db8-4747-9b08-026621aa0611 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.138848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.139539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.139815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.140089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.140918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:36.141762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.143188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d14d-a59e-441f-8188-52753fd80979 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.143548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.144398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.144839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.145176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.155926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.158018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.162299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 312/623] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:36.163660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371118f7-ddbf-464e-a76d-f495d9e56845 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.163958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371118f7-ddbf-464e-a76d-f495d9e56845 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.164234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371118f7-ddbf-464e-a76d-f495d9e56845 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.165727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 313/624] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:36.173329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371118f7-ddbf-464e-a76d-f495d9e56845 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a14ce159-2735-4770-9c79-2c003fb41600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:36.180686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:36.181795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:36.182866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:36.182866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:36.182866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:36.182866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:36.188556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 312/625] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:36.189915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.190343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.190692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.208825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:36.210097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:36.285543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 313/626] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:36.286492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.297822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371118f7-ddbf-464e-a76d-f495d9e56845 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.336840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.354412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.355391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.355864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.356335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.383023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.393656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5630-3862-46ff-b51c-31c60cc21c52 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.429784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.429999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.430911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.431398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.431547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.432026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.433039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:36.433672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.435311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.453064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 314/627] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:36.454757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.550730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 314/628] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:36.551754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.576455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2622c1-6d2c-4936-9cd2-e75e946cbf09 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.587481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.616614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.617879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.618582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.619616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.620208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.633303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:36.642512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:36.644724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 315/629] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:36.646920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.686025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb5b0c-ade3-4df4-866e-67ed41e89ad5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.730358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.731236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.731528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.731823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.740445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.742089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.751207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530673-6118-4ec7-941d-8f5b61c4afbf None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-b1984488-9c32-4df4-af05-61e38f7996b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:36.757101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:36.758090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 315/630] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5ddf-d4fc-4630-942b-042014c995ba None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.764955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5ddf-d4fc-4630-942b-042014c995ba None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.765574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5ddf-d4fc-4630-942b-042014c995ba None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.765574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 316/631] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:36.765574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5ddf-d4fc-4630-942b-042014c995ba None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.796163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.796954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.797233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.798129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.811700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.813767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:36.833012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:36.834021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:36.834946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:36.834946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:36.834946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:36.834946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:36.839105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 316/632] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:36.839947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:36.864419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.879915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5ddf-d4fc-4630-942b-042014c995ba None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:36.897310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:36.919949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:36.920605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.920880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.921151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.921888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:36.922836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:36.924231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6123a-af73-43e7-88d4-e2942393de23 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:36.934106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 317/633] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:36.936159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:36.936450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:36.936746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:36.956703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:36.960856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:36.968732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a1bb-675a-4ec2-b59b-df15a2c4ed89 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.007594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.008256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.008535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.008985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.009584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:37.009982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.011332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.028487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 317/634] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:37.029173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.043538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 318/635] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:37.043538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.114538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.136216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27922d-35d3-4ab1-b4e0-2ce463a93454 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.161061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a42d6-2a9b-4a93-8e35-3cf16244662b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.172927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.173247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.173586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.173864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.174251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.175045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:37.175482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.176939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.193379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 318/636] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:37.193379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.207743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.208883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.209343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.209792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.227488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.229254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:37.250058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:37.251757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:37.252854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:37.252854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:37.252854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:37.252854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:37.254506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 319/637] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:37.255686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.303437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8bc2b-d364-4eba-821e-b833476eac26 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.339774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.340661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.340950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.341225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/4d8b3103a87541c7ae82ca280985f174/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.354866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.359685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=4d8b3103a87541c7ae82ca280985f174, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.361192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.361929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c02f0-cce9-4bab-8bf6-1358377ba441 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.377704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 319/638] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:37 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/4d8b3103a87541c7ae82ca280985f174/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:37.379159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.404739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.405566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.405847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.406126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.418397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:37.426769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:37.427907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:37.428796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 320/639] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:37.429490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.455019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.517855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff84fd-d08c-429f-a2d4-2e21be736fa9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.542357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f51df-a25f-484c-90d4-ecdf33e23168 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.562031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.563850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.564721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.565370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.574545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.576381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.578113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.578770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.579052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.579326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.580075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:37.580380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.581714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b792f78-8db2-4460-a1d9-4f13e6d0c0fb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b31a0d73-f425-40af-84b2-598f83c0f558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:37.593286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:37.594334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:37.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:37.596143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 321/640] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:37.596143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb71da-f527-491c-9807-9627c04d7aa8 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.596143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb71da-f527-491c-9807-9627c04d7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.596340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb71da-f527-491c-9807-9627c04d7aa8 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.597949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 322/641] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:37.598334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 320/642] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:37.598626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb71da-f527-491c-9807-9627c04d7aa8 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.603078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.603361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.603747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.620723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:37.622172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:37.671314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.687690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.703541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 321/643] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:37.703541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.712828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb71da-f527-491c-9807-9627c04d7aa8 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.748596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.749256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.749537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.749813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.751114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:37.751421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.752809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.760861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 323/644] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:37.761476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.819218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d72826-0215-48eb-8c2e-24588f312be8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.858847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.860300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.860746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.861160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.862093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:37.862549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.864155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.865515 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531253-a384-45bc-a811-8b6062adb5ca None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:37.882955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 322/645] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:37.884089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.899483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:37.900297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:37.900582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:37.900857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:37.909020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:37.910454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:37.925110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:37.926023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 324/646] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:37.927140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:37.932994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.933364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:37.995175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84da55-20aa-43d2-bf6e-ae82cdf52a1b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.033724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.034554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.034794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.035069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.038330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5602aa-2fc1-4acb-b24f-eddb4d4bdc4f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.045658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:38.053995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:38.054922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 323/647] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:38.056165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.079394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.080211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.080496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.080766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.092209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.093642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:38.111746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:38.112689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:38.113567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:38.113567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:38.113567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:38.113567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:38.113567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 325/648] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:38.113849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.166824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.170236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.171471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e40a-2137-45f2-a24b-eb55da31dc9d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.207894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.208581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.208786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.209011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.212182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:38.212182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.212182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.227539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 324/649] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:38.227539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.232645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1a633-e7ff-4c85-aa71-c591a21ffa01 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.272771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.273552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.273903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.274252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.275174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:38.275615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.277178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.298619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 326/650] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:38.299630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.363759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204f71-0ca5-467f-892e-ba87454a8240 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.405110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.405784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.406070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.406348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.407694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:38.408004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.409379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.422165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97198a-5ff1-4b89-96f0-4641bfd0055a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.424836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 325/651] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:38.425672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.439468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.466293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.471808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.472469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.472758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.473027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.473746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:38.474056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.475426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.490521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 327/652] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:38.491386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.560783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe8800-d081-47d1-8a2d-5e75f4bbf32f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.600490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.601433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.601923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.602401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.619225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e82f2-fa8c-4088-8f5e-1975fed0543e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.654812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.655679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.655959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.656230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.668617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.669886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.675743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.677524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:38.688488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:38.689430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:38.690326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:38.690326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:38.690326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:38.690326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:38.690981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 328/653] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:38.691872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.709202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.721992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.794177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 326/654] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:38.795538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.801478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782c6a-5b8a-446e-a4ca-600ebc9d6ca9 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.846781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.848476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.848968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.849830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.861014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.863680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:38.883420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:38.884579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 05:53:38.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:38.889104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 329/655] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:38.890112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:38.915809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6345a0e-c9d9-4f12-9e5e-d46933c2c761 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:38.947094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:38.957789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:38.958445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:38.958721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:38.958994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:38.959740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:38.960047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:38.961411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:38.973966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 327/656] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:38.974859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.010568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.029620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6913b7-54c3-467a-8da6-d4c6e7d7dc7f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.067459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.068267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.068546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.068825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.080260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.081777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.101296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb071f4-7676-4268-b053-bf6d0360e630 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:39.103641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:39.104536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:39.105429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:39.105429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:39.105429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:39.105429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:39.105429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 330/657] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:39.106117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.153408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.154076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.155589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.156093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.157169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:39.157694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.159857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.183276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 328/658] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Jun 22 05:53:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:39.184394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.244616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.247766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548af3-e502-4b70-92e5-e5704dd9cf2d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.299828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.301526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.301994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.302439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.303413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391999-c4b9-4dd2-9ffa-d737cfcfa018 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.306818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.315853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.318190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:39.338375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:39.339355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 05:53:39.340334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:39.340874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.341152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.341813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.342200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.343139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:39.343292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 331/659] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:39.344403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.347815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.349344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.362928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 329/660] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:39.368011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.457413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538d332-7228-481b-b507-ef7979fa6deb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.480500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c733a-1110-4b16-a9e2-ba5177a5beba None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.483704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.498688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.499323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.499646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.500056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.519598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.520261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.520544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.520820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.521661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:39.521967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.523388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.546204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 330/661] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:39.547075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.565895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.574708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.576806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc25f2-c9f0-4b72-9bf9-dd6dbc0476ab None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.648999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f4fb7-bfee-41f1-bd61-a1f200640b52 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 332/662] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c82-c37c-489a-a5f2-698f1f0ec356 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c82-c37c-489a-a5f2-698f1f0ec356 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6c82-c37c-489a-a5f2-698f1f0ec356 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 333/663] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:39.689715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6c82-c37c-489a-a5f2-698f1f0ec356 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.693163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.693962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.694248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.694526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.701504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.702945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:39.717364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:39.718351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:39.719833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:39.723823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 331/664] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:39.724492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:39.751418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.790005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:39.798412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6c82-c37c-489a-a5f2-698f1f0ec356 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.833661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.834304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.834543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683b19-b619-4a08-b25d-383b50a0b320 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:39.834650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.834842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.871145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:39.871966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.872250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.872617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.883560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.885119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.902950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-252806a4-a6be-42fd-b63e-e1a5c19d75c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:39.903896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:39.904752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:39.905681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:39.905681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:39.905681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:39.905681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:39.905899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:39.905969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 332/665] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:39.906661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:39.907460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:39.907766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:39.924249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:39.925460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:39.996538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 333/666] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:39.997749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.005829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.012894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.023653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 334/667] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:40.024496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.110627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e8de9-1949-4d7f-96f3-14e6734881c2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.130262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7aa451-ca92-4f63-99ec-1757aed26694 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.147094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.147787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.148063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.148345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.149124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.149433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.150876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.166497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.167189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.167654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 334/668] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.167921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.168234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.168343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.168934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.169242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.170600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.186974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 335/669] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.186974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.237142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.250872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.279202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b96a-daf3-449a-bcfb-67c28aebf3ae None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.294684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9978-99f4-4bce-81e4-94b9c297641e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.314190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.315372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.315705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.315981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.326951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.328488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.330071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.331012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.331613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.331903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.343221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:40.345838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:40.346677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 335/670] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:40.348148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:40.355249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:40.356328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 336/671] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:40.357916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.455314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0806a0-3839-45a9-81f6-369e1f4928c6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.459422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312645-8b42-4000-89ec-bb3e96457e37 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.471756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.475588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.490752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.491394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.491770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.491977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.492801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=47e0e69820cb4c269c1d6043d70380f2) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.493107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.493205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.493974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.494258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.494527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.494617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.500150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 336/672] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/role_assignments?user.id=47e0e69820cb4c269c1d6043d70380f2&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.501431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.512113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.513626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:40.529690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:40.530811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:40.531874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 337/673] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:40.532436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.625847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd09f-3f5f-466e-8958-38b48e4b7017 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.646981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355cd8f-e782-4ce4-aaa8-137d4692695f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.666586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.667366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.667748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.668027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.669502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.669502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.671010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4b5e6-cf80-4e75-857d-9e28cc52dd70 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.683978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 337/674] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.685711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0699-c6ea-4190-a99e-d2e3806dfb15 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.685711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0699-c6ea-4190-a99e-d2e3806dfb15 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.685906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0699-c6ea-4190-a99e-d2e3806dfb15 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.687234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 338/675] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:40.687796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0699-c6ea-4190-a99e-d2e3806dfb15 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.694566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.695636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.696154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.696628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.698050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.698498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.700418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.709868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 338/676] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.710935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.735648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.757419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:40.799433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0699-c6ea-4190-a99e-d2e3806dfb15 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.819569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37de64-39d2-49b6-beee-b9a9c711a86d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:40.834791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.835539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.836002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.836317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.837296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:40.837611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.839323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae15dc3-f1c2-46f7-b7b8-7331581206b9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.857222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 339/677] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:40.857398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:40.857398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.857398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.857677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:40.857773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.857870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:40.857870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:40.865282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:40.866758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:40.874122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:40.875847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:40.881536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:40.882412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 339/678] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:40.888060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.963543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 340/679] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:40.963543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:40.996853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.005790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.010561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9b07-ba1f-45ec-99dc-d3faab771d01 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.050250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.050955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.051242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.051538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.062031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.063538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.069828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa5da6-be0b-4627-8fe8-b343875050be None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:41.081958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:41.083032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 340/680] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:41.083967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.111182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.111864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.112153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.112431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.113263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=3c6d629e689d45d4b28b24b7f3d0d3d8) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.113579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.115011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.121278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 341/681] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:40 2022] GET /identity/v3/role_assignments?user.id=3c6d629e689d45d4b28b24b7f3d0d3d8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:41.122047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.208663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124ccf-f0b7-4790-8fc9-f8eff255810a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.259962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.262134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.262648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.263120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.264019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.265045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.265587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.267593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.271806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686edd1-ca3c-4ae6-9718-60b5580fe13a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.286497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 341/682] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:41.286497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.299537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.320341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.321790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.321790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.321790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.338434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:41.348020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:41.349031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:41.350264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 342/683] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:41.351132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.401020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e974e0-23a6-4770-95dc-56dab603a16c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.441154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.442264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.442792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.443279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.444225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.444741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.446302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.460343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:41.461595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.480651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840d5e-e97a-415f-b19f-25820af95645 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.531046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.532311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.532597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.532875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.534292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1d7e8acb91804c358b40c90faa233296) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.534614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.536377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.537482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.551190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 343/685] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/role_assignments?user.id=1d7e8acb91804c358b40c90faa233296&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:41.551190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.568879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.603593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce050c5a-6aed-4ab9-9b61-93d57f049340 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.669238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97414082-eed2-43f6-a357-91ae7d3c1275 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.682206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.683288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.683787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.684298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.685360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.685927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.687542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.708793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 343/686] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:41.711854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.711854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.711854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.711854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] PATH_INFO: `/v3/users/swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.714487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.723391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.724934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:41.742312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:41.743320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:41.744900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 344/687] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:41.750670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.867838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47bd5-6836-428f-b52d-b8d5b52ee9e0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.869743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.900560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7b61-d767-49c9-9bf5-030e5886f6da None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:41.912978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.913807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.914313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:41.914833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.915267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.929973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.931849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.949915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:41.950901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:41.951379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:41.951868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:41.952894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:41.953123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:41.954594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:41.955492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:41.955492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:41.955492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:41.955492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:41.955492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 344/688] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:41.956550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:41.958202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:41.960782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:41.980836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 345/689] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:41.985793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.084461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb5310-7a55-4f50-b7fe-2e1b68dd225c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.121501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.122492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.122970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.123271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65ddd-af9d-4717-afaa-745e90008138 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.124070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.125004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:42.126057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.127657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.140274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 345/690] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:42.145799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.164987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.165644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.165939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.166583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.170717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.196933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.255933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74934a14-763e-4ced-80e6-5b5757602eca None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.264341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.266523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.324304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.325120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.325400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.325671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.345542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.347275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:42.382882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:42.383882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:42.384950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:42.389235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 346/691] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:42.394228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.397632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 346/692] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:42.403146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.440222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.511088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d1109-d504-4919-bfcf-208af44cabff None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.546501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.548245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.548782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.549278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.559878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.564610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:42.590173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:42.591140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:42.592085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:42.592085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:42.592085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:42.592085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:42.595727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 347/693] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:42.602319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.611715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ca6c-ccab-446c-8558-6855fed03d3a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.614693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.675864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.676910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.677432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.677912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.678951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:42.679493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.681130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.713485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 347/694] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:42.716648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.771849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.791909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816edf-1758-4ea8-bf2a-694a16525c87 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.843446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.845550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.846042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.846539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.847952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:42.848934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:42.851113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a4123-c623-4d28-a33b-1393841fe55a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:42.867389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 348/695] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:42.869022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776c81-ad72-427e-b80f-ff13fcb8c00d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.869448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776c81-ad72-427e-b80f-ff13fcb8c00d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.869890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776c81-ad72-427e-b80f-ff13fcb8c00d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.871544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 349/696] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:42.877924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776c81-ad72-427e-b80f-ff13fcb8c00d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:42.880185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb87c5-0ed6-4951-bfa0-0ee4e0cde8c8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:42.918558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:42.919467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:42.919923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:42.920345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:42.955343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:42.984842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776c81-ad72-427e-b80f-ff13fcb8c00d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.001214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.002999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.019791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.020638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.021015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.021382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.028522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.030401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-272ecaca-125e-46b9-962d-892379fcf3a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:43.045410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:43.046522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:43.047571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:43.050679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 350/697] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:43.053150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.053906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.054114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.072243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:43.073230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:43.075183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.123625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 348/698] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:43.124833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.147681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 351/699] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:43.148582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.193280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.239647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59621c46-ae0f-46c7-83a0-e85c7f14464c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.278289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.279313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.279621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.280001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.280891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:43.281328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.282797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49abcfa-5747-4ad9-a536-5c155bb04930 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.282921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.300694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 349/700] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:43.300694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.326086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.327107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.327556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.327969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.335247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.339864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.341436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:43.359547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:43.360492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:43.361380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:43.361380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:43.361380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:43.361380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:43.361380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 352/701] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:43.362090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.412577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fa596-c260-4d1a-8dcf-f31a671cefbe None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.438153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.451468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.452608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.453243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.454309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.455163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.456908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.463068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd893922-8808-46fc-8bc0-59f3430ff43d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:43.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:43.473689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:43.474528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 350/702] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:43.475388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.504809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.505445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.505743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.506001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.506822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=4d8b3103a87541c7ae82ca280985f174) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:43.507129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.508585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8a47-c447-46b2-bf37-984d693ae685 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.515538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 353/703] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/role_assignments?user.id=4d8b3103a87541c7ae82ca280985f174&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:43.516473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a66f8-e310-4757-acc3-b15f91760113 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.516755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a66f8-e310-4757-acc3-b15f91760113 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.517029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a66f8-e310-4757-acc3-b15f91760113 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.518517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 354/704] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:43.519232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a66f8-e310-4757-acc3-b15f91760113 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.584543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.620136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a651-38ed-4b82-a7fe-1ce2e1bb0032 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.638949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a66f8-e310-4757-acc3-b15f91760113 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.672504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.674408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.674761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.675109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.675939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:43.676316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.677721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ebbd-1417-4807-ac78-de38765e1651 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.682366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.683331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.683862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.684414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.685317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:43.685872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.687607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.691306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 351/705] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:43.692684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.692974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.693257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.694395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 355/706] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:43.702071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.716748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:43.718138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:43.783709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.814145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 352/707] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:43.815151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.846005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8fb64-0536-4ed8-8f3d-71b76b8de9a1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.865300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:43.882811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.883746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.884111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.884452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.892118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.893667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:43.908365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:43.909271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:43.910145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 356/708] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:43.910623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:43.922598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c844-a784-4b7f-bf5a-eaf56e550892 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:43.959359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:43.960073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:43.960355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:43.960624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:43.961436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:43.961741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:43.963366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:43.969816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 353/709] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:43.970850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.018706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:44.023371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e940-0765-406f-b9d8-7ba4d394bde2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.073011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.073739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.074019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.074297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.087200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e842458-95cf-4eb5-8efd-150b378bec21 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.093148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.094647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.124439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.125646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.125943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.126178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.126979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:44.127286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.128777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:44.135932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:44.138043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:44.140217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:44.140217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:44.140217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:44.140217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:44.140217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 357/710] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:44.147601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 354/711] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:44.152090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.157105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.237570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:44.285182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:44.288145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce7d3-00c0-4cc7-aaca-cd98c4330901 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.329067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2533c-3a9d-486f-aba4-5df3faea9ec9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.335919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.337064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.337355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.337640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.339107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:44.339435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.341498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50001-0506-460c-841e-55106c8b7e10 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.349371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 355/712] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:44 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:44.351112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8ee2-c27b-4fad-b042-ec828bce4a1a None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.351407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8ee2-c27b-4fad-b042-ec828bce4a1a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.351756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8ee2-c27b-4fad-b042-ec828bce4a1a None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.353431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 356/713] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:44.360032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.360386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.360593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.381870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:44.383265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:44.407473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.408162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.408441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.408753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.409441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:44.409747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.411114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.445841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:44.451215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.464977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 357/715] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:44.490137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.601891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:44.612144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ede45-17fa-4e7a-a3d9-56e8c13ed721 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.641121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:44.648279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af50782-b6eb-421e-be73-54e64bebd735 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.659916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.661109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.661721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.662076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] PATH_INFO: `/v3/services/network` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.662819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.664409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:44.694400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:44.695473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:44.696347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:44.699026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 358/716] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:44 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:44.704780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:44.718035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.719330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.719670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.719949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.720726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.726918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.790384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 359/717] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:53:44 2022] POST /identity/v3/users => generated 254 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:53:44.874039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc91475-3242-4def-ae67-65bffed91a9c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:44.922772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:44.923433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:44.923734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:44.924004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:44.924705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] RBAC: Adding query filter params (name=network) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:44.925006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:44.926420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1167-337b-41c6-b795-4a9bda669017 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:44.931537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 359/718] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:44.937319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:45.042750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f16581-73ad-41cf-8a7b-8b86d4864e82 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:45.079087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:45.079772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:45.080056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:45.080327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:45.081040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] RBAC: Adding query filter params (type=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:45.081345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:45.082707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3592f-0d4a-4c11-b1b2-7a147f83617f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:45.089106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 360/719] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:45.908657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536465-b24a-41d9-b0f3-b9f1de7008f8 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:45.909174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536465-b24a-41d9-b0f3-b9f1de7008f8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:45.909251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536465-b24a-41d9-b0f3-b9f1de7008f8 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:45.910814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 360/720] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:45.915671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:45.916053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:45.916246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:45.935599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:45.936781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:45.944551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:46.028100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 361/721] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:46.060064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536465-b24a-41d9-b0f3-b9f1de7008f8 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:46.089350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:46.186199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536465-b24a-41d9-b0f3-b9f1de7008f8 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:46.244071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:46.244857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.245193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.245469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.261679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e1414b5c-a3d1-4db0-9ba6-938b9f8a94b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:46.269396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:46.270296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:46.271743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 361/722] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:46.276430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:46.302930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c58931-fa50-4b9d-8ae0-39bbd954fccb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.303266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c58931-fa50-4b9d-8ae0-39bbd954fccb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.303487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c58931-fa50-4b9d-8ae0-39bbd954fccb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.305139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 362/723] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:46.309906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.310204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.310489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.327843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:46.329174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:46.458681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 363/724] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:46.478204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a557103-0d83-42df-9e99-7822d1f516ab None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:46.482397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:46.509705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:46.512359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:46.513027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.513307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.513587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.514367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:46.514671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:46.516264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:46.526517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 362/725] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:46.533783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:46.536485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:46.672665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7888-6046-4182-9e41-86856e6fc319 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:46.677042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fce2c-f595-4a23-9269-84152cd7d4d1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:46.714843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:46.715575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.715859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.716132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.728546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:46.729995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:46.748956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:46.750083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:46.751806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:46.751806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:46.751806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:46.751806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:46.751806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 363/726] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:46.753132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:46.753818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.754100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.754374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.755116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:46.756561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:46.766789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:46.789045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 364/727] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:53:46 2022] POST /identity/v3/services => generated 251 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:53:46.838813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:46.892150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdc0e2-2ca7-483c-b25c-d17be19ff4f5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:46.942259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:46.943064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:46.943191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:46.943468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:46.944218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:46.944523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:46.945915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19c10-8101-405e-a7e7-192135a0a061 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:46.966788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 364/728] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:46.972239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.060140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.093943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb45dd-de79-4e82-842b-58a7f6c1d381 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.127818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903445-405d-47b7-8939-62932665eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.128659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903445-405d-47b7-8939-62932665eb5a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.128937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903445-405d-47b7-8939-62932665eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.129268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903445-405d-47b7-8939-62932665eb5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.133104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f120-3762-442d-9fbe-1815aad8d336 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.133386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f120-3762-442d-9fbe-1815aad8d336 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.133660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f120-3762-442d-9fbe-1815aad8d336 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.135013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 365/729] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:47.140329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.141204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.141485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.142023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903445-405d-47b7-8939-62932665eb5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:47.143634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903445-405d-47b7-8939-62932665eb5a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-85903445-405d-47b7-8939-62932665eb5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:47.160642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:47.161636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:47.163180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:47.163901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:47.163901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:47.164045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 365/730] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:47.167543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903445-405d-47b7-8939-62932665eb5a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.250750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 366/731] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 05:53:47.275238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.280659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903445-405d-47b7-8939-62932665eb5a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.313483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.325981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.326653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.326939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.327212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.328158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:47.328471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:47.329911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:47.346535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.372911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 366/732] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:47.376154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.428426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161a9c1-ce30-4374-b46a-477c6cfbefb0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.464528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.465666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.466144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.466653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.477749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:47.483292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e30e91-d83f-4aae-96a3-6ecc93b33297 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:47.486313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:47.487232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:47.488093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:47.490797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 367/733] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:47.496172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.554467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.555658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.556139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.556646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.663256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.673765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:47.676098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd93a4-0b6e-4a62-be18-66f4b654ad94 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:47.677497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.682306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664742f-8367-4cd8-91d3-70bdc91726d1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.727423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.728817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.729152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.729557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.730418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:47.730828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:47.733206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf6cfd-1063-45d8-86dd-380cbc0e570a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:47.747640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 368/734] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:47.749266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673806-4a83-48a5-a2af-595327a9b5a0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.750781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673806-4a83-48a5-a2af-595327a9b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.751060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673806-4a83-48a5-a2af-595327a9b5a0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.752838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 369/735] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:47.754830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673806-4a83-48a5-a2af-595327a9b5a0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.811422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 367/736] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 05:53:47.813326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.813822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.814350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.832134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:47.833662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:47.864388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673806-4a83-48a5-a2af-595327a9b5a0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:47.898554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:47.899348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.899669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.899952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.908413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 368/737] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 05:53:47.909150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.919864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:47.922906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:47.931793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8c4165e9-8589-417e-8a89-0187101a701c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:47.947253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:47.948646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:47.949537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:47.949537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:47.949537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:47.949537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:47.949537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 370/738] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:47.954796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3341-a6ad-49b3-a946-b9afae5b0496 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:47.954796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3341-a6ad-49b3-a946-b9afae5b0496 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:47.954796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3341-a6ad-49b3-a946-b9afae5b0496 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:47.955331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 371/739] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:47.956124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3341-a6ad-49b3-a946-b9afae5b0496 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:47.973820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.016284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a443-fce8-4ee1-bd08-bc18ca757567 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.053274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.054047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.054328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.054598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.065245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.066827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.067192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3341-a6ad-49b3-a946-b9afae5b0496 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:48.084957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:48.085865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:48.086772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:48.086772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:48.086772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:48.086772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:48.090934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 369/740] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:48.091919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.107300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.107699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.107979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.108255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.108968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.110349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fdaa-be7a-44cb-8187-b93a1a5ff6f9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.124449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 372/741] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:53:47 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:48.125628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.125918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.126192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.144920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:48.146196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:48.185931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.225371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5eceb-914f-499b-b971-a42ad8fa87cf None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.239099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.252940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 373/742] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:48.261201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.295634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.295634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.295634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.295634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.296062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:48.296062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.296251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.310230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 370/743] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:48.311119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.392360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b9247-edda-4e2a-aa67-370007a9526b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.430297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.431331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.431873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.432342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.433264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:48.433764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.435331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.443937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efc78-9936-4d81-8af1-81e68c48f32f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.448238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 374/744] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:48.449281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.483287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.490626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.491417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.491732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.492007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.507239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:48.513939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:48.520414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:48.521357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:48.522232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:48.526617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 371/745] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:48.527466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.565193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c84a-df9b-4b26-8d2c-dcd251f1d71d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.602633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.603996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.604492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.604962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.613978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.615997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:48.631162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:48.632148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:48.633100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:48.639787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 375/746] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:48.641548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.645625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d7ddf-dda1-40b1-a237-efaf6a4dbbb1 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.682701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.683491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.684207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.684207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.692114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.693746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:48.709886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:48.710802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:48.711806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 372/747] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:48.712294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.751153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65520d-c54c-448f-882d-beda8ad8aba7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.770278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.772630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:48.786663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.787675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.788156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.788628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.789559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:48.790076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.791772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.801508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 376/748] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:48.802610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.831120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb419a-a970-4d71-84c9-85df5733733a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.875907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.877088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.877888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.878485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.879672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:48.880352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.882592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:48.909748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 373/749] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:48.909748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:48.933667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19e83-1a47-4b84-8207-9dd231f0f3de None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:48.979793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:48.980464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:48.980726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:48.981003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:48.981795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:48.982104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:48.983571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.003875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 377/750] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:49.005017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.043140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3a67-5876-48d4-8710-b1f538d482ab None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.055254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.056959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.083728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.084532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.084817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.085091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.095905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.097387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:49.116093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:49.117029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:49.117922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:49.117922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:49.117922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:49.117922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:49.117922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 374/751] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:49.118213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.123521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd07834-fd7d-413f-8c7f-d7308e0f1acb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.155394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.156737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.157023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.157298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.168014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.169471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:49.187850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:49.189870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 378/752] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:49.191995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.233635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d3df6-2655-4863-b21b-da205a6f3fd4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.269501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.270158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.270441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.270717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.271609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=4d8b3103a87541c7ae82ca280985f174) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:49.271920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.273344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.279121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 375/753] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/role_assignments?user.id=4d8b3103a87541c7ae82ca280985f174&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:49.279955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.307663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.314875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3bb60-b241-48bd-b8c5-03dfddf5aaef None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.315773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.356671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.357524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.357910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.358289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.359197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:49.360174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.361696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4afe9-119b-4c24-840f-c6f2745c1bc1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.374599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 379/754] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:49.376236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bb73-8f02-42a3-8a7c-67fb33bb6b04 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.376630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bb73-8f02-42a3-8a7c-67fb33bb6b04 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.377015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bb73-8f02-42a3-8a7c-67fb33bb6b04 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.378647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 380/755] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:49.380676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bb73-8f02-42a3-8a7c-67fb33bb6b04 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.402921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc1fc-b7ac-4a5d-b37d-8f9b47493805 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.441992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.442665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.442951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.443241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.444098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:49.444403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.445786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132df58b-4ae3-4f5f-80b2-0013481c5899 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.459132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 376/756] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:49.460530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125298-fd04-4256-8667-82635c58541f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.461184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125298-fd04-4256-8667-82635c58541f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.461184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125298-fd04-4256-8667-82635c58541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.480904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fc125298-fd04-4256-8667-82635c58541f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:49.482472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fc125298-fd04-4256-8667-82635c58541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:49.497872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bb73-8f02-42a3-8a7c-67fb33bb6b04 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.532412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.533943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.534429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.534899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.544600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.546523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.571069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 377/757] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:49.571069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc125298-fd04-4256-8667-82635c58541f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:49.571307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:49.572716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:49.573727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 381/758] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:49.580270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.598140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.602907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.681763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc125298-fd04-4256-8667-82635c58541f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.687733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12caa8a-b1df-4870-9383-9b437eed76d1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.718330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.719984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.720433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.720845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.727883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.728669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.728787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.729127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.729501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.730455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:49.730816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.730927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.732559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:49.744994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:49.746055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:49.746952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:49.749302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 378/759] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:49.750388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.756823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 382/760] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:49.757853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:49.836418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.843554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:49.856678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cacdc-6281-4bbd-8554-be68b2f4be9c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.875917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512989-ebc7-408f-925a-460f06a49ebd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:49.901575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.902987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.903377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.904045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.904959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:49.907604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:49.911134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:49.912019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:49.912442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:49.912886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:49.922270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:49.923257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:49.924153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:49.927643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 379/761] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:49.928728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.006422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.007939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.034663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9470f-3648-4b97-9c73-388b9bfa69d7 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.079110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.079809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.080039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.080311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.081199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:50.081507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.082914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.093615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.097318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 380/762] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.098634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.106233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.144502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 383/763] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:53:50.145430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.238119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ca96b-7e65-42e3-a7c1-92b8c2006275 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.256595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad99b6f-d4bb-4ee6-85d5-7a8fd2869ccd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.285884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.286550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.286832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.287288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.287850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:50.288162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.289539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.291856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.292731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.293007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.293278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.295635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 381/764] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.295635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.296341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=217be31925ad4d859522dce86af2ca45, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.298790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d847f-871e-41d4-881a-c44de40a1564 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.316223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 384/765] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:50 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:50.317507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49e65c-f53c-4bc0-880a-b51eebad277c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.317793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49e65c-f53c-4bc0-880a-b51eebad277c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.318073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49e65c-f53c-4bc0-880a-b51eebad277c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.319525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 385/766] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:50.320107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49e65c-f53c-4bc0-880a-b51eebad277c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.361909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.396598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.442657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cbf87-cfc3-43de-bd97-fcd6cd495b3d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.444681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49e65c-f53c-4bc0-880a-b51eebad277c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.483039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.483979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.484849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.485127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.485244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.485881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.486113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.486382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.487144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:50.487448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.488881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be2457-c528-4330-8729-de39470ad89e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.496601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 386/767] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.496940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.498517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.498628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.499319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.500468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.519583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:50.520708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:50.521376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:50.522320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:50.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:50.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:50.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:50.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:50.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 382/768] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:50.524186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.596486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 387/769] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:50.597436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.625485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.654727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd24b2-5090-487b-81f8-25d3084dab27 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.674681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.706556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.707882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.708621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.709526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.710836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] RBAC: Adding query filter params (interface=public, service_id=f74e752a6e6c4e9095e2412a9e9f8f72, region_id=RegionOne) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:50.711656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.714183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.718930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1be3aa-abe4-4351-9637-2c7c29a3f7fe None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.727275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 383/770] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/endpoints?service_id=f74e752a6e6c4e9095e2412a9e9f8f72&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.728392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.760182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.760818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.761102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.761375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.762240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:50.762592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.764063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.782116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 388/771] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.782988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.858675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e84c3a-286a-41f9-9b7a-af9ebc07b62e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.882851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.895752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.896767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.896881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.897070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.897922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.899245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.904028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d418a-5f2e-4d5a-b3c6-1c5e439a2e85 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:50.911813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:50.912816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:50.913671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 384/772] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:50.914494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:50.951133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:50.953086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:50.953533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:50.953961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:50.954818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:50.956382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:50.966255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:50.969839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 389/773] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:50.970907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.041612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e49b-89d2-4d16-b9f0-b5c10c2655c9 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.086153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.088600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.089071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.089508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.107166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.110489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:51.146174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:51.147345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:51.149038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:51.151310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 385/774] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:51.157525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.204396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9b8-12a3-4d91-a0c7-97b3f1dc803d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.257036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.258226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.258226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.258687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.259485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] RBAC: Adding query filter params (name=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:51.259940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.261521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.267425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 390/775] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:51.272446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.290833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54e83-9312-4521-9886-d73c7ecb11f6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.291118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:51.301270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:51.338429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.339097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.339380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.339702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.340500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:51.340811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.342259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.356121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 386/776] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:51.361967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.447591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40144aa-6b50-428b-a888-210b7a3fb6aa None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.501645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.502287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.502566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.502840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.503591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] RBAC: Adding query filter params (type=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:51.503900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.505263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b02cb-4fc2-423e-9947-791d858287dc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.510637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 391/777] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:51.516449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb62b-9b58-48d2-a5a9-224dcc59adac None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.516736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb62b-9b58-48d2-a5a9-224dcc59adac None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.517012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eb62b-9b58-48d2-a5a9-224dcc59adac None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.518279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 392/778] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:51.522527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eb62b-9b58-48d2-a5a9-224dcc59adac None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.539824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432de6-81d0-4151-8aae-5aa6c2a3a83a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.580969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.581671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.581960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.582239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.583130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1fdb302d62da4b2b8e6c238e11d08f62) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:51.583484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.585158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bdb61-1fe3-4f06-b8a8-4ecb6e565949 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.591911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 387/779] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/role_assignments?user.id=1fdb302d62da4b2b8e6c238e11d08f62&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:51.593200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.593523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.593904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.609692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:51.613359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:51.614943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:51.667891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:51.670016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eb62b-9b58-48d2-a5a9-224dcc59adac None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.737315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.739288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.739612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.739898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.740469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 388/780] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:51.740972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] RBAC: Adding query filter params (interface=public, service_id=d4b505797a234dd9be8131fbe1d72845, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:51.741291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.742750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.751312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 393/781] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/endpoints?service_id=d4b505797a234dd9be8131fbe1d72845&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:51.756685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.777327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:51.866492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429f38-140c-49c3-b5f7-70dba3c4c1c4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.902474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.903133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.903440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.903726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.904412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:51.905787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:51.915547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 389/782] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:51.918712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acdacb-b746-48a1-8bd1-2e4dcf099ce6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:51.964218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:51.965376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:51.965809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:51.966277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:51.984543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:51.994230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:51.995402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:51.997176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:52.005116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 394/783] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:52.011401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.045277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:52.130265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb454fd-b7b0-49de-bc16-6f3ed41c3862 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:52.167982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:52.168920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.169354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.169820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.170768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:52.171242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:52.172809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:52.182298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 390/784] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:52.188592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.198347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:52.306398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287cb1b-d2cc-4057-9bce-4110c253b601 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:52.354981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:52.355802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.356083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.356360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.367852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:52.369312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1eb09a6a-2d1a-4a57-9b30-04678e86571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:52.386996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:52.387951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:52.389051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:52.389051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:52.389051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:52.389051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:52.389051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 395/785] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:52.400609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.496266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:52.513148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2c3f-561e-4c48-a21a-a716c63fd7bf None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:52.523825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0154e3-9d35-4ee3-828a-ff418a9431e9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.525305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0154e3-9d35-4ee3-828a-ff418a9431e9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.525962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0154e3-9d35-4ee3-828a-ff418a9431e9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.531550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 396/786] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:52.533322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.533810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.534410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.552518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:52.553985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:52.567653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:52.569619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.570301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.572823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.573762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:52.574294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:52.578198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:52.611670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 391/787] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:52.614871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.652995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:52.700104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 397/788] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:53:52.740994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.781493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b8f0-6205-4c4c-b0f7-92f586960174 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:52.854571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:52.855359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.855667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.855943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:52.871551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:52.873050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:52.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:52.890676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:52.892279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 392/789] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:52.896640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:52.903535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:52.923851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703dfde-29fc-4d40-be00-5fa0be5d80e7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:52.985835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:52.986633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:52.986914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:52.987191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.007150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:53.015517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:53.016477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:53.017535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 398/790] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:53.024077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.091175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69759-fdf0-473e-b056-c8b39724ad13 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.128997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.130917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.131617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.131897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.132174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.133015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:53.133327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.134754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.170159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 393/791] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:53.176475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.245168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.258278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fce98-9855-430e-854e-fe11ebc2d375 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.287105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aae5b-2cb3-4270-8300-bb39dd231f6b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.323535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.324323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.324611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.324889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.336340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.337274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.338079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.339126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.339661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.340275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.341225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:53.341728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.343892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:53.356809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:53.357723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:53.359668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:53.359668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:53.359668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:53.359668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:53.359668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 394/792] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:53.363831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.366184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 399/793] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:53.371713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.490444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f927e-a8bb-405d-994e-6cfb46f7574f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.492877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d27f-dc13-450e-93ce-1d9b1da54487 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.507458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.511871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.533782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.534756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.535195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.535867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.536793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:53.537241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.538797 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.553829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 395/794] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:53.559819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.586859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.588143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.588531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.588955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.612977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.614588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:53.656789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:53.657942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:53.659054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:53.659054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:53.659054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:53.659054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:53.665010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 400/795] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:53.666293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.675936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f33d3-2ac2-48c1-9dc3-621472f93ef3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.716277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.717440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.717874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.718334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.726584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.728856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:53.745603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:53.746544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:53.747468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:53.750684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 396/796] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:53.756306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.791412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.819319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7faa71-0574-4c4d-9907-0cdde195cbf4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.855517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.856268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.856649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.857029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.857952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:53.859715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.861197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5ce19-c831-4731-a161-c88b5523f79f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.861903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda265e-0183-417f-bf56-38d4730578f5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:53.879037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 401/797] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:53.880682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1183e0-04dc-4334-ae42-b54764ab5bcd None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.881146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1183e0-04dc-4334-ae42-b54764ab5bcd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.881527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1183e0-04dc-4334-ae42-b54764ab5bcd None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.883592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 402/798] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:53.884868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1183e0-04dc-4334-ae42-b54764ab5bcd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:53.899969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:53.900908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.901398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.901851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.902812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:53.903303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:53.904948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529f62a-aed3-46d2-a884-34167617497e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:53.905806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:53.917672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 397/799] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:53.923972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:53.924507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:53.924972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:53.942335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:53.943831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:54.003569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1183e0-04dc-4334-ae42-b54764ab5bcd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.028855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 398/800] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:54.029858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.045866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.047186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.047467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.047789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.059623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.061102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.066268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6e924b96-88a8-4c6d-ab61-96e415f19866 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:54.078382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:54.079496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 403/801] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:53:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada8eb-56d6-4016-a4ec-1441d416d5f4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.085240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada8eb-56d6-4016-a4ec-1441d416d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.086113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada8eb-56d6-4016-a4ec-1441d416d5f4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.086113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 404/802] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:54.086113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada8eb-56d6-4016-a4ec-1441d416d5f4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.154620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5b1b0-1139-4c4e-83a3-f01002e7c191 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.172786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.190341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.191315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.191698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.191969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/4d8b3103a87541c7ae82ca280985f174/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.193934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=4d8b3103a87541c7ae82ca280985f174, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.195349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dd185-64db-4876-a6b8-541647eec3f7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.199044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada8eb-56d6-4016-a4ec-1441d416d5f4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.219694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 399/803] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:54 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/4d8b3103a87541c7ae82ca280985f174/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:54.219694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.219694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.219694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.236351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.237174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.237459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.237733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.238397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.240534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.246958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:54.248404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:54.257469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:54.258494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 05:53:54.259369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:54.260191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 405/804] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:54.260610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.342712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 400/805] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:54.343790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.375917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.416687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cca93-a1b5-427a-83a2-ebfef8ff14ee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.462020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.463211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.463678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.464103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.465098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:54.466119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.468830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.479726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd706384-09bf-44b1-b02c-dfc81dd5bb38 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.487861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.493652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 406/806] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:54.494839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.523089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.523709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.523997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.524429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.525072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:54.525293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.526734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c726ac7-a0f4-430a-9536-f12c730f55d8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.532654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 401/807] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:54.533423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844eda8-af06-443f-af85-e0a71bda44a0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.533711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844eda8-af06-443f-af85-e0a71bda44a0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.533989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844eda8-af06-443f-af85-e0a71bda44a0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.535360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 402/808] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:54.535921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844eda8-af06-443f-af85-e0a71bda44a0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.607806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e98dc-c8df-44ed-908e-fef2163767bb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.621672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.644777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.645565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.645829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844eda8-af06-443f-af85-e0a71bda44a0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.645936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.646110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.658104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:54.665730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:54.666642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:54.667574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:54.672264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 407/809] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:54.672964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.683741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.684519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.684805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.685081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.733517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.762208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.763683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.781614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c922add-8fec-4dda-8407-eaad721967a0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.823795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:54.824575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.825092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.825378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.826488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:54.827054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:54.828973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924f2b-91f8-471a-84bc-b6aa2ce3762e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:54.835970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 408/810] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:54.837447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:54.838217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:54.838700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:54.845428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:54.856591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:54.858223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:54.868847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 403/811] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:53:54.869602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.939534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 409/812] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:54.939534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:54.985693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d2bcb-c29e-4158-866a-3a98e4d348d1 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:54.988919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.021691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.022349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.022633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.022909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.023682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:55.023989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.025345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.034191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 404/813] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:55.034906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.041014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeedf4b-2d36-45e7-8523-e026b476c905 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.078355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.080269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.081398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.081686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.081995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.082714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.084420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.112454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 410/814] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:53:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:55.124635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.159079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c71ef-4591-4cc1-97d9-a3314b888514 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.214604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.215841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.216372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.216861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.229422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.231320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:55.254257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:55.255248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:55.256168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:55.256168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:55.256168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:55.256168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:55.257957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25d222-e6e0-4015-a99f-9710e1e9e8df None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.258364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 405/815] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:55.259443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.270724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.303765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.304855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.305312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.305756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] PATH_INFO: `/v3/services/network` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.306584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.308253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:55.321961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:55.323046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 05:53:55.324786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:55.327378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 411/816] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:55.328922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.367404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.386007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9da26-2430-4c3f-a826-1e243713f4af None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.421937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.423057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.423539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.424045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.435361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.437869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.440266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975297-4e28-4ce7-a125-c1e8135ef80f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:55.457087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:55.458001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:55.458892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:55.458892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:55.458892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:55.458892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:55.465721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 406/817] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:55.466781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.475486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.476189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.476477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.476759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.477675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:55.477852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.479233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.491863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 412/818] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:55.492805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.527901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.574061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf8736-3503-4ed1-ae4e-2a02e83ce581 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.594713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf0a1-32c7-472e-8e9d-dfdf9d350aad None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.610651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.611649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.612172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.612761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.613789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] RBAC: Adding query filter params (name=network) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:55.614290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.615982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.626234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 407/819] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:55.627362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.632984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.635021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.635714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.636000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.636280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.637009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:55.637392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.638796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.655160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 413/820] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:55.655160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.745035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fa698-b6dc-4880-8260-95d44de4a9da None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.758901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.765904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80174a-ecb7-4ace-96b5-377b48343d09 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.786209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.787348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.787916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.788395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.795853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.798264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.801760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.802429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.802710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.802990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.803766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] RBAC: Adding query filter params (type=network) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:55.804076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.805456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.815771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 414/821] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:55.815771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:55.820331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:55.821228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:55.822157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 408/822] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:55.822639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:55.894242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:55.933455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2ff2-96e4-43de-8824-7dfe0e572439 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.936084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eaa09-b0b5-4553-a350-bc15a7d247e1 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:55.969981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.970788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.971086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.971351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.974701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:55.975660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:55.976159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:55.976656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:55.977637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.979183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.979914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:55.981366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:55.997478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:55.998490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:53:55.999457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:56.003703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 415/823] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:53:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:56.004563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.015923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 409/824] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:53:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:53:56.017452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.155132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7674d-b064-4c40-8f0a-2e478f5be3b0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.157440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.176817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.197883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.199111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.199686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.200206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.201274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:56.201890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.203735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.225192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 410/825] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:56.231246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.247327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f435ea-90ff-4e2a-815f-a0099cc89345 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.295480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.296213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.297026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.297300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.298103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:56.298413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.302821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.315907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 416/826] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:56.322058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.366103 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8c4a-8612-4132-ab38-4171ce88f022 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.403991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.405366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.406423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.406893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.408952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.419277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.421074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.432888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f49ec-7c26-43c6-bb6a-4d06bb6f1e75 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-afdb40dc-364c-406b-97e6-aef9816883bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:56.440999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:56.441922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:56.442803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:56.442803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:56.442803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:56.442803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:56.445066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 411/827] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:56.446516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d4fa-efa8-4837-9ac5-5343b74455f0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.447046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d4fa-efa8-4837-9ac5-5343b74455f0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.451588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d4fa-efa8-4837-9ac5-5343b74455f0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.451588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 412/828] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:56.456186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9d4fa-efa8-4837-9ac5-5343b74455f0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.480085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.481684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.482163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.482635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.484212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:56.484750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.486776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a23b29-b37e-4044-a5a1-1412a3e2aa46 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.490225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.494972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 417/829] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:56.496905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.497732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.498215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.520560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:56.521899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:56.582171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9d4fa-efa8-4837-9ac5-5343b74455f0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.611653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 418/830] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:56.620887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.621993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.622494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.623021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.624029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:56.624578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.626213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.629892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.640511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 413/831] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:56.646424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.708177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.742085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484730-c6c9-464b-a038-09cb28fc9efa None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.747470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:56.765564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8910-fb9d-460e-999b-4b1b5fa12c03 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.784230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.785034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.785318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.785597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.800655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:56.802184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.803066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.803420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.803798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:56.808975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:56.809979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:53:56.810830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:56.811472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.813127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:56.815541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 419/832] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:56.817829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:56.829722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:56.830681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:56.832129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 414/833] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:56.837236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:56.945271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf923-5084-447f-b412-1bff07763aee None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.960787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6052-e036-44ad-a559-1d70f3f286c0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:56.983205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:56.984029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:56.984378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:56.984933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:56.985569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:56.985948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:56.987441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.003917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.006047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 415/834] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:57.006948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.010102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.011844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.015892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.016175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.016941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:57.017249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.018631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.022133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.031553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 420/835] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:57.033927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.138272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c97f-3281-439d-8347-a7ed56c52a27 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.145285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2be7a-8f07-48c4-8442-1c03500b42a2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.174933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.176106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.176536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.177051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/1fdb302d62da4b2b8e6c238e11d08f62/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.180580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.182021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.182021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.182021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.194416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.195152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=1fdb302d62da4b2b8e6c238e11d08f62, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.196223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.197014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.212850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 416/836] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:53:57 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/1fdb302d62da4b2b8e6c238e11d08f62/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5b7fe73c-7344-4015-acf5-f63a2455bbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:57.218415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:57.219377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:57.220294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:57.220294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:57.220294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:57.220294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:57.222794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 421/837] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:57.230083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.299971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.316692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91415-e27d-4e40-946e-0e82913e3ed9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.317464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91415-e27d-4e40-946e-0e82913e3ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.318853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91415-e27d-4e40-946e-0e82913e3ed9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.320842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 422/838] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:53:57.326718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.327334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.327878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.348739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:57.350549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:57.351190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7040b-3ffc-4848-8033-b2690da46d05 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.395177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.395906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.396191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.396469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.397196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:57.397502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.399199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.408364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.418335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 417/839] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:57.419703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.437396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 423/840] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:53:57.459712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.548288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279905-c263-4c6a-8956-9f1df4cfa3a3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.570840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.578995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494bf8-8a8b-4518-bdac-3926c24e526a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.597644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.598803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.599090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.599372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.610535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.612661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.619342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.620183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.620464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.620740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.621405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.622758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:53:57.628910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:57.629816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:57.630752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 418/841] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:57.636773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:57.639519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:57.640886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:53:57.642581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:57.647215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 424/842] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:57.647215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.693981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.764470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b153c3-2114-4e06-a058-22f8e36a46b3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.770203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f528c-7536-46ec-bd81-2488fc9e07a7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.812144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.812539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.812759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.813001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.813205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.813304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.813492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.813774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.819525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:57.819525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.819713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:57.819713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.819863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.819937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.821649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 425/843] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:57.826945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.838724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 419/844] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:57.844689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:57.878696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.940105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a812594-144f-43b3-9628-113cad899b51 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.942538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:57.950497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961153-98b3-49d9-975c-29db0058a5ec None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:57.977745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.978409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.978695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.978975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.979716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:57.980024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:57.981461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:57.991668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:57.992755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:57.993238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:57.993761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:57.994387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 426/845] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:53:58.188430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:58.189891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:58.223269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:58.291357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 420/846] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:53:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:53:58.297993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:58.403141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68104fe-93c1-43cc-aaa1-c3261d4a01eb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:58.440185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:58.440886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:58.441168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:58.441439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:58.452799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:58.454227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:53:58.471995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:58.472920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:58.473806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:53:58.473806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:53:58.473806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:53:58.473806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:58.473806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 427/847] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:58.480243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:58.583624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73c57-b820-4737-b61f-1ce688b16908 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:58.619037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:58.620098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:58.620636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:58.621111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:58.622018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:58.622537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:58.624127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a1a19-573b-43ab-acb0-e8d182fa816f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:58.632821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:58.636583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 421/848] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:58.642420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:58.665340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:58.734757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7725-b46f-4a75-a1b3-e1d7536bf7fb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:58.734959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7725-b46f-4a75-a1b3-e1d7536bf7fb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:58.735216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a7725-b46f-4a75-a1b3-e1d7536bf7fb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:58.736865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 422/849] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:58.741737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:58.742021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:58.742301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:58.748800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64292f63-03d1-466e-8ce2-bc4233d72c26 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:58.759218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:58.760440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:58.792445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:58.793681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:58.794183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:58.794602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:58.803951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:58.806118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:53:58.826262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:58.827417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:53:58.828587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:58.830859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 428/850] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:58.831466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 423/851] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:53:58.836199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:58.853216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:58.937963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:58.960634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea293-c568-4db7-8cbb-22190fa8b46d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:58.966802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cc42-a710-4838-b834-497ffa838a17 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:58.987423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:59.002784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.004005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.004350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.004944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.005427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.006856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.014152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.015153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.015659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.016127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.017082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:59.017567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.019165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:59.019897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:59.020818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:53:59.021671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:53:59.026139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 424/852] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 22 05:53:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:53:59.027044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.037007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 429/853] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:59.042729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.135211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b243d6d-b361-4cf9-acde-143451df70dc None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:59.174077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad923a9-9a85-4a9d-95a9-2d3428ae60a2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:59.177755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.178667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.179115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.179555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.180433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:59.180911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.182458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.189150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 425/854] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:59.195037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.217749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.218835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.219218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.219625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.220964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=4d8b3103a87541c7ae82ca280985f174) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:59.221377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.222911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746cd03-5b1e-447f-b8c0-8758f6192125 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.233220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 430/855] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/role_assignments?user.id=4d8b3103a87541c7ae82ca280985f174&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:59.271707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:59.324239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479141c-f246-446f-b0fe-7ad38f5e52cb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:59.366260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.366938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.367218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.367495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.368233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:59.368538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.369905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174e3f-8034-4e50-acc4-bc12656bb070 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.376179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 426/856] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:59.430144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752571-00f1-415c-aec9-52898f4e0d6d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.430425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752571-00f1-415c-aec9-52898f4e0d6d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.430728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f752571-00f1-415c-aec9-52898f4e0d6d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.432460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 431/857] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:53:59.439182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.439475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.439786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.459068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:53:59.460368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:53:59.537933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 427/858] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:53:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:53:59.562016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f752571-00f1-415c-aec9-52898f4e0d6d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.567493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:59.674056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f752571-00f1-415c-aec9-52898f4e0d6d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:59.708669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.709451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.709728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.709997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.721989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:53:59.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:53:59.730545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:53:59.731408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 432/859] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:53:59.737130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.783912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:53:59.838848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc9db-ffbd-4e2a-8c87-73628efc4d7c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:53:59.877908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:53:59.878564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:53:59.878841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:53:59.879155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:53:59.879986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:53:59.880287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:53:59.881641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:53:59.890539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 428/860] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:53:59.896157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:53:59.961343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:00.001206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb2f56-3b50-41f5-96d1-7954aa75998a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.036999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.037782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.038060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.038326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.049176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.050615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a8a273b6-4524-4332-92d5-7b6678ed95db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:00.069147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:00.070081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:00.070992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:00.070992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:00.070992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:00.070992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:00.070992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 433/861] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:00.080643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:00.158365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34f6-0c42-4bb0-abe5-a804ad9f295b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.158695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34f6-0c42-4bb0-abe5-a804ad9f295b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.158915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d34f6-0c42-4bb0-abe5-a804ad9f295b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.160560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 434/862] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:00.165470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.165862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.166148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.183351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:00.184572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:00.189880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca24e38-9cc2-4ff6-a0e8-dddfba48fd41 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.200555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:00.244912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.245571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.245853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.246129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.246847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:00.247396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.249295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.265432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 429/863] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:00.270620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:00.277511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 435/864] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:00.301203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:00.350382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:00.383863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f960-c532-46db-b027-e74a15a20755 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.406453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366c59-2e57-4e19-b249-644bcb9157b0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.420909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.421682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.421968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.422259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.429682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.431000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.444512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.445439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.445942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:00.446255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:00.447155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:00.448122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:00.449384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.450373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.451846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 430/865] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:54:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:00.452289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.454141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:00.470247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 436/866] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:00 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:00.492898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:00.586170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3fc59-e9be-40fa-b657-5442b5e65610 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.630734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.631411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.631727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.632004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.632847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:00.633156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.634662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.654879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 431/867] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:54:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:00.660443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:00.770464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0eee-e148-4b59-b7db-1fde9ef1a1ee None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:00.780733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:00.808848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:00.809505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:00.809792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:00.810073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:00.880270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:00.881733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:00.985002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 437/868] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:00 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:00.990610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.083150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.102544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f9d-0a63-454f-9d73-a3d7f93017e9 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.139009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.139863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.140150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.140426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.151051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.152526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:01.174474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:01.177028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 432/869] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:01.183536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.190639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.297324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf3f51-8eef-41b9-8346-3e11ae58dc75 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.332207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.333147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.333634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.334061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.334924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:01.335376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.336919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aaa61-aec0-4d3d-93ca-f12b972f6e4b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.351406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 438/870] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:01.357394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.461569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c6925-1568-411f-bdaf-b418f4ee21b7 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.494549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f740a-31b6-4386-9f88-1b0046b2c071 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.494549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f740a-31b6-4386-9f88-1b0046b2c071 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.494866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f740a-31b6-4386-9f88-1b0046b2c071 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.496496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 439/871] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:01.501372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f64ac-1718-4e69-99cc-4dc2b94e5b62 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.501663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f64ac-1718-4e69-99cc-4dc2b94e5b62 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.502154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f64ac-1718-4e69-99cc-4dc2b94e5b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.506870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.508152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.509455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.509741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.511858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.517844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.519099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-af2f64ac-1718-4e69-99cc-4dc2b94e5b62 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:01.519710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.520309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af2f64ac-1718-4e69-99cc-4dc2b94e5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-0af191f3-4efc-4836-a32d-a7b5d677b920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:01.533799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:01.534690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:01.535616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 433/872] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:01.536747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f171a-c150-42c3-b4f8-f971dcee9584 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.536747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f171a-c150-42c3-b4f8-f971dcee9584 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.536747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f171a-c150-42c3-b4f8-f971dcee9584 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.539543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 434/873] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:01.540329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f171a-c150-42c3-b4f8-f971dcee9584 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.589942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.599175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 440/874] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:01.602618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.602618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.602618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.620940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:01.622262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:01.656482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f171a-c150-42c3-b4f8-f971dcee9584 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.691086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.691811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.692069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.692392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.693112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:01.693418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.693925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 441/875] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:01.694624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.703263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.723861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 435/876] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:01.724964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.789660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.811079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97774c1a-7ce1-4100-bd46-d1df64aa016e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.839602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:01.844092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37a2d-5280-4cbb-b4a3-def786eec423 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:01.850130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.850797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.851082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.851360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.852110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.853479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.867172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 442/877] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:01 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:01.867809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:01.893116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:01.894609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:01.895129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:01.895948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:01.897416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:01.899770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:01.918083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:01.919184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:01.920056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:01.922940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 436/878] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:01.928585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:02.007470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3125-4060-4004-9ca5-3734aaba575f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:02.044173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dabf38-4b9d-4ec3-909e-6ef7610bc8cc None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:02.046016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:02.046940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.047403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.047873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.048927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1fdb302d62da4b2b8e6c238e11d08f62) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:02.049386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:02.051037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:02.058422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 443/879] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/role_assignments?user.id=1fdb302d62da4b2b8e6c238e11d08f62&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:02.064488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:02.088595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:02.089525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.089982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.090412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.091290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:02.091792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:02.093396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec2454-ac5a-41ac-857d-2f9c3e74a918 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:02.099494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 437/880] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:02.105676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:02.161302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:02.224966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b30b0e-1507-4fb4-9866-8c1566496f20 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:02.261582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:02.262246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.262525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.262796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.263497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:02.263821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:02.265755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4961ec-a73e-42f8-926c-c726c156bf9a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:02.270612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 444/881] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:02.706449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcefb4-1959-4d6c-b33c-8a587067a26d None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.706969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcefb4-1959-4d6c-b33c-8a587067a26d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.707049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcefb4-1959-4d6c-b33c-8a587067a26d None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.708646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 438/882] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:02.714189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.714484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.714766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.731919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:02.733107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:02.808824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 445/883] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:02.831389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcefb4-1959-4d6c-b33c-8a587067a26d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:02.939553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcefb4-1959-4d6c-b33c-8a587067a26d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:02.974254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:02.975017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:02.975297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:02.975598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:02.976291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:02.977641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:02.990245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:02.991214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:02.992117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 439/884] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:02.999549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:03.046821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:03.106225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6045d-d896-4a28-b127-43d7f16b312f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:03.143525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:03.144527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:03.145012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:03.145522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:03.146424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:03.146946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:03.148533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:03.153697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 446/885] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:03.159990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:03.204212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:03.261882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930e80b-4ecf-4326-85fc-a6d34e997cc7 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:03.296114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819718-d099-4f31-b70d-71206926e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:03.296756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819718-d099-4f31-b70d-71206926e01c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:03.297034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819718-d099-4f31-b70d-71206926e01c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:03.297305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17819718-d099-4f31-b70d-71206926e01c None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:03.297998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819718-d099-4f31-b70d-71206926e01c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:03.298297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819718-d099-4f31-b70d-71206926e01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:03.299671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17819718-d099-4f31-b70d-71206926e01c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:03.304916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 440/886] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:03.310599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:03.414995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474170-ab0e-4d6f-a27d-a98cdf65440a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:03.425324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:03.453426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:03.454494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:03.454977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:03.455461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:03.456477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] RBAC: Adding query filter params (interface=public, service_id=e1437516dc8a4c33ba52d43b66821fbf, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:03.456987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:03.458579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793eee-e4f6-4ef6-a60f-01c25cf86006 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:03.465815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 447/887] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:54:03 2022] GET /identity/v3/endpoints?service_id=e1437516dc8a4c33ba52d43b66821fbf&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:03.472377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819718-d099-4f31-b70d-71206926e01c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:03.575233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17819718-d099-4f31-b70d-71206926e01c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:03.581994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:03.610357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:03.611005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:03.611284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:03.611581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:03.612261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:03.613611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dcd50-7617-49e5-a169-d942f1d1250d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:03.619733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 441/888] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:03 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 05:54:04.051069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba4cca-a015-476b-9b73-a2e595d4c343 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.051613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba4cca-a015-476b-9b73-a2e595d4c343 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.051691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba4cca-a015-476b-9b73-a2e595d4c343 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.053271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 448/889] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:04.058615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3e36-1d0f-4a61-bca2-aac5f4019af4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.059025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3e36-1d0f-4a61-bca2-aac5f4019af4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.059196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa3e36-1d0f-4a61-bca2-aac5f4019af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.076691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dcfa3e36-1d0f-4a61-bca2-aac5f4019af4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:04.077958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dcfa3e36-1d0f-4a61-bca2-aac5f4019af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:04.148914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 442/890] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:04.172529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba4cca-a015-476b-9b73-a2e595d4c343 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.266931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed765ef-27af-4741-814b-daf3dbf29f15 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.267226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed765ef-27af-4741-814b-daf3dbf29f15 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.267530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed765ef-27af-4741-814b-daf3dbf29f15 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.269173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 443/891] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:04.274219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.274580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.274933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.291760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba4cca-a015-476b-9b73-a2e595d4c343 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.295663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:04.297850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:04.329753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.330842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.331329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.331819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.332668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:04.334142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:04.347584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:04.348564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:04.349418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:04.352320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 449/892] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:04.357936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.383576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 444/893] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:04.407538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.411919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.438532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.476169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede5e7-97d3-482c-92a4-4f95664ca43d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.512487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5d380-0d2d-4b61-a4cc-b05f922595c5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.515751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.516417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.516703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.516984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.517687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:04.517996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:04.519373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7b13-3399-4d3a-8ffb-fee2f6642322 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:04.529650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 450/894] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:04.529650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca88e7-773e-4e33-870e-458d3761a55f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.529650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca88e7-773e-4e33-870e-458d3761a55f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.529650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca88e7-773e-4e33-870e-458d3761a55f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.529650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 451/895] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:04.530902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca88e7-773e-4e33-870e-458d3761a55f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.555012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.555972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.556249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.556522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.567393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-834a8dc8-94d3-4cad-8381-2d9916a71a07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:04.575835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:04.576755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:04.578146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 445/896] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:04.578835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.579385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.579385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.596881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:04.597976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:04.638705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.643437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca88e7-773e-4e33-870e-458d3761a55f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.679526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 446/897] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:04.679526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.691566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.692910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.693675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.694024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.694306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.695144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:04.695532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:04.697063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:04.703542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 452/898] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:04.703542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.783961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ceba5d-d057-4e69-81dd-1ae31081e886 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.813214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aebf2-2cfc-4a0d-8ee1-315e53a07d9d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:04.821686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.822355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.822642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.822923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.823692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:04.823999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:04.825371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:04.838894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 447/899] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:04.838894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.854581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:04.855188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:04.855469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:04.855767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:04.856482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:04.857834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:04.872097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 453/900] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:04 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:04.884657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:04.924124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.942177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:04.964620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f982b42-cb3c-48dd-b47f-c36f7c385a29 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.009043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.010158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.010644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.011138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.012185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] RBAC: Adding query filter params (interface=public, service_id=dfafe1544859468292bb76e5789d861d, region_id=RegionOne) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:05.012787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.014527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.021677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 448/901] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/endpoints?service_id=dfafe1544859468292bb76e5789d861d&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:05.027580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.041413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf23b5-6559-448f-8ef9-31bed4249e9b None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.085915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.086719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.087001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.088068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.099688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.101317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:05.126578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:05.127677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:05.128605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:05.128605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:05.128605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:05.128605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:05.128992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 454/902] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:05.134100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.159046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b78b65-dca2-45db-8871-1a86efe02a2e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.226407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:05.229392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.230449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.230702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.231001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.231704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.233257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.247081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 449/903] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 05:54:05.256638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f4bb-beac-4e46-9745-19f42aca8452 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.294345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.295021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.295315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.295627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.296917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:05.297226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.298754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.313033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 455/904] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:05.318845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.329840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:05.432405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795af8-eceb-40c3-b3e7-b2d984db1602 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.469394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.470187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.470466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.470736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.478626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.480102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:05.494998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:05.496018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:05.497112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 450/905] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:05.503913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.606867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb399000-9682-4c61-b1e2-b59c94a41f28 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.641955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.642671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.642956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.643232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.644109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:05.644416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.645850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96b627-ee3e-4a67-8640-2374a1db99ea None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.648481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:05.664555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 456/906] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:05.670214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.731442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd807-c843-4f97-b7d2-b0eb1b172106 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.731753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd807-c843-4f97-b7d2-b0eb1b172106 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.731955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd807-c843-4f97-b7d2-b0eb1b172106 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.733470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 457/907] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:05.738592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.738795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.739072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.745188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:05.757783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:05.758963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:05.790206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdeac4-d66f-4300-872d-a94fdec79e59 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.829697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 458/908] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:05.832696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:05.833344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:05.833628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:05.833909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:05.853380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:05.911901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:05.913803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:05.983274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05a2c8-7183-4435-bf23-6e16f4e87ffa None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:05.984445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.019488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.032039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.033740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.034249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.034744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.035654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.036234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 451/909] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:06.037467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.042383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:06.053797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:06.056295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 05:54:06.057144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:06.059321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 459/910] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:06.065705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.172705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcea78-e821-46d2-911e-089de6db913b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.198253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781634b-321c-4077-a7b1-256a61b5513e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.221886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.222814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.223195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.223594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.234698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.236224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.242928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.244158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.244585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.245000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.246218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:06.246832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.248440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.254271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 460/911] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:06.256600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:06.257502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:06.258480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:06.258480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:06.258480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:06.258480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:06.264765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.264890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 452/912] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:06.266373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.285332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.325485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.374762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae53a7-11a0-46bc-be23-b8f74cd88a9a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.381362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd3cfd-d865-4dc6-9b80-e161bb10e6f2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.410755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.411419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.411731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.412010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.412884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:06.413075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.414394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.418515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.419429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.419950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.420431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.421925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:06.422438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.424049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.427538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 453/913] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:06.434869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 461/914] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:06.435830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.436448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.523957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.542540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81163-e950-4ad8-8760-3626cd7f1a12 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.549987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d16b4-e487-4c68-8705-94b123135f67 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.560201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:06.580179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.581044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.581329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.581670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.582528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.584000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.587899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.588938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.589438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.589925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.598637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.600453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.611529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 462/915] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:06.624319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:06.625357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:06.626327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:06.630001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 454/916] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:06.632213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.757274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2b12-3e76-4676-982c-92fd889bdf04 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.793688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.794278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.794557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.794887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.796501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:06.796813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.798255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba638f9e-fe02-40e1-bf43-c955c21bfb8d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.815581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 463/917] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:06.817565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:06.925059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f7efc-a017-4444-a389-c344670e3291 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:06.960271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:06.961313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:06.961806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:06.962560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:06.963648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] RBAC: Adding query filter params (role.id=2f26d507b4734a358b054793154a11cb, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1fdb302d62da4b2b8e6c238e11d08f62) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:06.964166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:06.965907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb608-8976-4ecf-9b5d-c0bba84521f6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:06.972847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 455/918] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:06 2022] GET /identity/v3/role_assignments?user.id=1fdb302d62da4b2b8e6c238e11d08f62&scope.project.id=e576abf81756447c87069069c29d7003&role.id=2f26d507b4734a358b054793154a11cb => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:07.009779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc7e5-1049-45d8-9050-18d651569e4b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.010098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc7e5-1049-45d8-9050-18d651569e4b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.010344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc7e5-1049-45d8-9050-18d651569e4b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.012066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 464/919] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:07.018214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.018502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.018780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.024084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.038195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:07.039594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:07.116376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 456/920] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:07.139265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dc7e5-1049-45d8-9050-18d651569e4b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.175702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.255311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dc7e5-1049-45d8-9050-18d651569e4b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.291102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.291922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.292203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.292475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.293123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.294484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-66b4c62c-85c5-4a22-bcfc-9b86899a35ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:07.306689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:07.307777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.308630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 465/921] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:07.314399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.410621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2951-1267-4272-bb76-7d444d006c6b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.410812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2951-1267-4272-bb76-7d444d006c6b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.411077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2951-1267-4272-bb76-7d444d006c6b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.412838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 466/922] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:07.415094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d520229-20d1-4a69-9f25-c26faa7c0746 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.417902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.418187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.418465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.437897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:07.439092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:07.450286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.459887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.460861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.461880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.462608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.463805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:07.464545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.466903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.473857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 457/923] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:07.479743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.531602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 467/924] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:07.556755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.588092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.596488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd082d-7656-4448-94c8-65e84c051ab8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.632171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.632817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.633096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.633370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.634065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:07.634368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.635852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.641096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 458/925] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:07.646861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.700126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095ef0-e732-4a2b-be26-a566961137e9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.710405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.742517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.743747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.744305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.744796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.745670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.747255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.760096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ac959-f31c-4e7d-b661-99d50e506a31 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:07.760870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:07.761821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 05:54:07.762730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:07.765626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 468/926] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:07.771339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.812100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.812754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.813032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.813301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.814085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] RBAC: Adding query filter params (interface=public, service_id=2690a2bdc5f3418ea8294c0fc2fa7d98, region_id=RegionOne) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:07.814385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.816327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.827572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 459/927] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/endpoints?service_id=2690a2bdc5f3418ea8294c0fc2fa7d98&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:07.830201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.870299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.893107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375ee4-dccb-4a5a-b6a4-0bab4a3abcc8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.936501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a42caa-7a0c-4b2b-945f-8ef672a62702 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:07.938670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.940247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.940527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.940801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.941503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:07.941807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.943167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.952729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 469/928] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:07.953960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:07.966804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:07.979494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:07.980334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:07.980717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:07.981093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:07.981976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:07.984162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:07.999875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 460/929] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 05:54:08.064463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcb36-ded8-4dc0-9d0d-832e6ebc86c0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:08.106072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:08.106755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:08.107041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:08.107320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:08.108737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:08.109052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:08.110453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f5fd5-a755-4e71-88ae-3ae343f597d3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:08.116529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 470/930] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:08.122268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:08.232559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3416-da45-4952-8ec9-45a9689a98d3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:08.267210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:08.267891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:08.268168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:08.268436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:08.269176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:08.270525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e59416-592e-43fd-ab1d-0d895e170fec None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:08.296250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 461/931] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:08.887063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed831e-ae06-46d5-b73d-83b1a8d98b1c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:08.888090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed831e-ae06-46d5-b73d-83b1a8d98b1c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:08.888597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed831e-ae06-46d5-b73d-83b1a8d98b1c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:08.890962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 471/932] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:08.896411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b5ab-d102-4f79-bbe2-7bfe52b2a006 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:08.896794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b5ab-d102-4f79-bbe2-7bfe52b2a006 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:08.896959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b5ab-d102-4f79-bbe2-7bfe52b2a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:08.914047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-1878b5ab-d102-4f79-bbe2-7bfe52b2a006 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:08.915211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1878b5ab-d102-4f79-bbe2-7bfe52b2a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:08.956911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:08.993913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 462/933] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:09.018060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed831e-ae06-46d5-b73d-83b1a8d98b1c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.035030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:09.090228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5964-7957-4f37-b507-082805658a4f None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.090554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5964-7957-4f37-b507-082805658a4f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.090785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5964-7957-4f37-b507-082805658a4f None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.092484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 463/934] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:09.097433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.097855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.098171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.115283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:09.116487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:09.126629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed831e-ae06-46d5-b73d-83b1a8d98b1c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.160267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.160868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.161158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.161443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.162195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.163813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:09.165263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING keystone.server.flask.common [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 05:54:09.187170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.sql.core [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 05:54:09.187170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 05:54:09.187170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [parameters: {'id': 'b82cba38f2814caebfb8fcff183fc74f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 05:54:09.187170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79994) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 05:54:09.197915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 464/935] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b82cba38f2814caebfb8fcff183fc74f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b82cba38f2814caebfb8fcff183fc74f. Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:54:09.204889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 05:54:09.207408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application yield resource Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise self.value Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application session.commit() Jun 22 05:54:09.208418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.session.flush() Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application compat.raise_( Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 05:54:09.209313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 05:54:09.210291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application result.read() Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:54:09.211145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [parameters: {'id': 'b82cba38f2814caebfb8fcff183fc74f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.212718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:09.214197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b82cba38f2814caebfb8fcff183fc74f. Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.223785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 472/936] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Jun 22 05:54:09 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:09.224951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.226927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.323193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:09.327122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c940-769f-4cb1-8475-bbad4cf48fd2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.360008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:09.364130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98423f2-8cbd-4f02-937d-69fd32a02ed3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.365223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.367560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.367560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.367560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.374573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.377404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:09.393333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:09.395299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:09.396479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 465/937] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:09.401406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.412777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.413530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.413821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.414096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.428756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:09.440089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:09.441254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:09.442737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 473/938] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:09.448280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.526660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cabc-5d06-4452-a499-4e634a08d82b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.563118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.563816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.564100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.564376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.565127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:09.565432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.566978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:09.580271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7cad-5c48-461d-985a-c1cade6fc7ef None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.587881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 466/939] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:09.614518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:09.622683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.623366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.623758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.624035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.624799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:09.625103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.626708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:09.639415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 474/940] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:09.644798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.670461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:09.761163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646421e1-3131-405c-8fa5-f3879add1679 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.801128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.801913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.802191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.802463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.813186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.814627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:09.833579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:09.835674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:09.837944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:09.837944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:09.837944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:09.837944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:09.837944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 467/941] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:09.841754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:09.955574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d089-b342-4f73-990d-b6f291d96a49 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:09.991006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:09.991702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:09.991988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:09.992265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:09.992992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:09.993300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:09.994670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f3a29-0927-4080-b7db-223efde52712 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.007576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 475/942] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:10.013177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.088800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.120013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367605c-dd45-4f9b-844c-754d7f8d1248 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.121702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90a5a-0152-4fc5-9361-f239936945a8 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.121992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90a5a-0152-4fc5-9361-f239936945a8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.122268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e90a5a-0152-4fc5-9361-f239936945a8 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.124104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 476/943] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:10.131754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.132159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.132541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.150122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:10.151807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:10.160682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.161756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.162247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.162670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.170592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.172369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:10.188624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:10.189631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:10.190589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 468/944] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:10.195459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.216328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.252133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 477/945] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:10.276069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.328762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea94749-5507-4340-80c0-d310c5639679 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.361883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.367356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.368151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.368822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.369390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.370313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:10.371590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.372494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.392479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 469/946] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:10.400193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.410319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919422-ef7b-448c-b509-54b9a171bc0f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.446729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.447546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.447834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.448108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.448762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.450129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1b740a66-ac37-42f2-96e3-a4e39dc77031 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:10.462916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:10.464105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:10.464952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.469182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 478/947] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:10.470605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43404-ec12-455e-b880-3caa6b3f965b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.470890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43404-ec12-455e-b880-3caa6b3f965b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.471166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43404-ec12-455e-b880-3caa6b3f965b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.472711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 479/948] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:10.473233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43404-ec12-455e-b880-3caa6b3f965b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.511256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e810-4190-4e26-b120-95747ed84190 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.524046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.546696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ee761-28c3-4397-9788-872de593a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.547462 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ee761-28c3-4397-9788-872de593a798 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.547768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ee761-28c3-4397-9788-872de593a798 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.548041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ee761-28c3-4397-9788-872de593a798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.558683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ee761-28c3-4397-9788-872de593a798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.560139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ee761-28c3-4397-9788-872de593a798 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-010ee761-28c3-4397-9788-872de593a798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:10.577867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:10.578748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:10.580217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:10.580217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:10.580217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:10.580217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:10.580217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 470/949] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:10.580510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.580805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.581041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.587336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43404-ec12-455e-b880-3caa6b3f965b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.597283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:10.598441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:10.623264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.624510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.624801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.625065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.625761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:10.626068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.627422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.632650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 480/950] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:10.634459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.638027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.679532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 471/951] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:10.679532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.741625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771f9c-1bfe-480d-ae64-4391c8c48351 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.753525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.779937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.780596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.780880 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.781155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.781869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:10.782181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.783555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.785787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030883b6-c71a-4745-ae19-f19ddfdbef72 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.795230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 481/952] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:10.796849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.825907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.826689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.827049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.827397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.828227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:10.828542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.829910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.835932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 472/953] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:10.836723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.879622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:10.912467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241415ea-d175-4070-9c5a-312b5a923e87 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.948347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46ef9e-d142-43b1-b36b-8388c3b02b01 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:10.948547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.949293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.949599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.949961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.951220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.952164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:10.964915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:10.966596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:10.968426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 482/954] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:10.969279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:10.990007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:10.990793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:10.991072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:10.991345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:10.997994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:10.999393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.004252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:11.013041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:11.014397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 473/955] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:11.015366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:11.079027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97342a5-7259-478a-a0c0-778b14368e36 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:11.116069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:11.116953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.117437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.117944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.118576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:11.119734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:11.121512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.124836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3719dd-3a5c-4112-b99e-9dd8c58f9970 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:11.142832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 483/956] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:11.143678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:11.183549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:11.184401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.184690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.184969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.186108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] RBAC: Adding query filter params (name=compute) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:11.186430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:11.188238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.195808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 474/957] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:11.200752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:11.276811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:11.289909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cd758-466f-4525-8b62-9fbb4a250a82 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:11.335443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:11.335707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053c42-6990-4f2f-98fb-90f14bda906e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:11.336131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.336413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.336686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.337738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:11.338046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:11.339491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.354262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 484/958] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:11.361584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:11.377100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:11.378291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.378573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.379153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.379938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:11.380245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:11.382296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291992e1-9790-4d2b-af4d-18fe3a3324f9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.388852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 475/959] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:11.483457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019c49-49d8-41ee-adf9-c97d90d798b1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:11.523222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:11.524179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.524554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.524855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/1fdb302d62da4b2b8e6c238e11d08f62/roles/2f26d507b4734a358b054793154a11cb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.527303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=1fdb302d62da4b2b8e6c238e11d08f62, role_id=2f26d507b4734a358b054793154a11cb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:11.528731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015ddc0-0780-47f6-b0d1-7257fb07a791 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:11.547067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 485/960] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:54:11 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/1fdb302d62da4b2b8e6c238e11d08f62/roles/2f26d507b4734a358b054793154a11cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:54:11.812951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17836a-c9a8-49fe-9d7f-ef0920b8ec39 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.813298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17836a-c9a8-49fe-9d7f-ef0920b8ec39 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.813419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17836a-c9a8-49fe-9d7f-ef0920b8ec39 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.815030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 476/961] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:11.820428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:11.820755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:11.821070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:11.838551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:11.840095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:11.843843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:11.912599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 486/962] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:11.937134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17836a-c9a8-49fe-9d7f-ef0920b8ec39 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:11.960960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:12.044790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17836a-c9a8-49fe-9d7f-ef0920b8ec39 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:12.082231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:12.082816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:12.083098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:12.083369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:12.084190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:12.085729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:12.087274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING keystone.server.flask.common [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 05:54:12.100834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.sql.core [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 05:54:12.100834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 05:54:12.100834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [parameters: {'user_id': '414f18ba9bf7460ebd965fa8ae7df2d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 05:54:12.100834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79995) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result.read() Jun 22 05:54:12.108500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:54:12.109399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application yield resource Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application next(self.gen) Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise self.value Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application session.commit() Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 05:54:12.111113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.session.flush() Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application compat.raise_( Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 05:54:12.113047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 05:54:12.118817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application conn.query(q) Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application result.read() Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 05:54:12.120155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [parameters: {'user_id': '414f18ba9bf7460ebd965fa8ae7df2d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:12.121811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 05:54:12.122894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:12.124686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 477/963] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Jun 22 05:54:11 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:12.125606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:12.226014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1c52d-c79a-4c1b-a817-a06a3a797e08 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:12.260099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:12.260901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:12.261219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:12.261532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:12.269307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:12.270822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:12.273374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-319a82ab-885d-4a67-802a-e8cd003cf4eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:12.286738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:12.289067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:12.291601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 487/964] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:12.295426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:12.380566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:12.399600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a918db-2751-47c2-80a8-31162e99f069 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:12.433902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:12.434568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:12.434847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:12.435118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:12.436524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:12.436835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:12.438447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74014d-accd-44da-ab76-50df6cad5f6d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:12.475851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 478/965] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Jun 22 05:54:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:13.235489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933544-f05f-4801-addb-6d85dc78fc8f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.235954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933544-f05f-4801-addb-6d85dc78fc8f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.236137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84933544-f05f-4801-addb-6d85dc78fc8f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.237638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 488/966] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:13.242678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.243054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.243230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.260344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:13.261839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:13.329913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 479/967] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:13.352773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933544-f05f-4801-addb-6d85dc78fc8f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.451638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84933544-f05f-4801-addb-6d85dc78fc8f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:13.485469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:13.486196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.486514 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.486837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.487540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:13.488913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f639f736-547d-4c2a-8e52-43ee891eb4b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:13.500868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:13.501856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:13.502722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:13.504131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 489/968] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:13.507916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.527152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6433-d224-4886-9ff1-2909e00cd061 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.527485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6433-d224-4886-9ff1-2909e00cd061 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.527811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6433-d224-4886-9ff1-2909e00cd061 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.529297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 490/969] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:13.534478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.534805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.535120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.552256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:13.553488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:13.577086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:13.612149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112de9-d1ec-4852-a7d6-f179873b5ec6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:13.617106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:13.631539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 491/970] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:13.646084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:13.646736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.647016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.647288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.648048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:13.648326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:13.649678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:13.652019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.659858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 480/971] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:13.660774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.749947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbc63-7b6f-45c8-a1ce-7ac1b29efdcb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:13.760492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cbda7-46b4-46c8-ba91-e2fc87691d8c None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:13.783839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:13.784565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.784849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.785121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.785835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:13.787198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d7cc2-bea5-4066-9a8c-b220410b835b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:13.794325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:13.795037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.795357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.795658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.796353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:13.796657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:13.797989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:13.799339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:13.800445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 492/972] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:13 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:13.801675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068add-515f-4a29-8d89-3481c8b0fa80 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.801964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068add-515f-4a29-8d89-3481c8b0fa80 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.802243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11068add-515f-4a29-8d89-3481c8b0fa80 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.806240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 493/973] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:13.806383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 481/974] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:13.813121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.813403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.814550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.815233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.841587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:13.843402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:13.898928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:13.930976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 494/975] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:13.937290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255783c2-95b6-4dc8-bc7b-d84241454293 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:13.956369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:13.976853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:13.977505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:13.977791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:13.978065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:13.978858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] RBAC: Adding query filter params (interface=admin, service_id=2690a2bdc5f3418ea8294c0fc2fa7d98, region_id=RegionOne) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:13.979173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:13.980558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:13.986380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 482/976] 10.222.0.13 () {56 vars in 1249 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/endpoints?service_id=2690a2bdc5f3418ea8294c0fc2fa7d98&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:13.992295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.059646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:14.063837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975489-28cd-4a5c-a9e8-7c368c3d0348 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.101114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.102847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.103352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.103862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.104214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3d912-62bc-4525-a38c-63eee2a9b065 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.116176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:14.125108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:14.126095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:14.127620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 495/977] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:14.131714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.144132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.144788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.145063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.145337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.146011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.147380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.153838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 483/978] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:13 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 05:54:14.177089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:14.248875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5178-a045-43a0-ae65-6ba39a4b0780 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.285568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.286253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.286537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.286815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.287615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:14.287928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.289902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.299367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 496/979] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:14.305127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.413720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd567-2c0d-42ca-ab4a-e960edace795 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.440596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:14.449724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.450519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.450806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.451084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.461425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.463132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:14.480756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:14.481673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:14.482590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:14.482590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:14.482590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:14.482590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:14.483845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 484/980] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:14.488363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.587527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1a3bd-a1ea-4dfd-989e-20975b2dc836 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.589063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:14.622195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.622940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.623865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.624216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.625035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:14.625413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.626861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.638668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 497/981] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:14.644184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.742910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502b12-97e0-43ff-af68-3bc8ad77f239 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.775365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.776192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.776480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.776758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.784351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.785790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:14.801160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:14.802169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 05:54:14.803147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:14.807530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 485/982] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:14.808208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:14.918159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fdccc-bec3-4458-9aee-1e4f08109cf3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:14.956273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:14.956952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:14.957273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:14.957583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:14.958435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:14.958740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:14.960198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:14.978892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 498/983] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:14.984938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:15.026022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:15.086133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20712b04-acef-459a-8d67-04c36ef89b3a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:15.121421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:15.122052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.122333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.122605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.189187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:15.190606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:15.237756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:15.315630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 486/984] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:14 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:15.320597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:15.346341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:15.430999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac5e2-99bd-4653-8eaa-49bb898654e8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:15.467698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:15.469365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.469977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.470435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.481563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:15.484018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:15.502459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:15.503657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:15.504826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:15.504826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:15.504826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:15.504826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:15.507087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 499/985] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:15.512714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:15.617076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568445d-0ce2-4785-98b6-a9854b4ce516 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:15.657629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:15.658653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.659443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.660225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.661579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:15.662079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:15.664351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:15.674271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:15.685524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 487/986] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:15.687376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:15.773157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:15.804596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0913-8d95-4d76-96ab-824e64598c53 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:15.838779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:15.839615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.839941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.840257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.847605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:15.849073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-9c8af148-1088-44c3-8813-84239a6b0d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:15.862890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:15.863835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:15.864721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 500/987] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:15.871309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:15.872089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39033f-a30f-4f16-b81f-19f225c7e69c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.872407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39033f-a30f-4f16-b81f-19f225c7e69c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.872712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39033f-a30f-4f16-b81f-19f225c7e69c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.874465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 501/988] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:15.879410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:15.879782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:15.880106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:15.898242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:15.899430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:15.971136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 502/989] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:15.987417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1497a4-5583-4af0-840e-17aa8d2d911e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:15.993461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.023992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.024735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.025030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.025307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.026090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.026406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.027848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.041230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 488/990] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:16.047043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.056576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.098944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784417-2e6e-4b9f-93a9-bc01a626e633 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.109434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.136144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.136872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.137194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.137505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.138186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.140151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:16.152233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:16.153229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:16.154106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 503/991] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:16.157710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2094b-5b37-4a69-b15f-62ec2c88c86b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.159746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.195121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.196067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.196490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.196908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.198066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] RBAC: Adding query filter params (role.id=2f26d507b4734a358b054793154a11cb, scope.project.id=e576abf81756447c87069069c29d7003, user.id=1fdb302d62da4b2b8e6c238e11d08f62) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.198532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.200307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae1d7f-f085-44d7-b998-faf835d59d78 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.207292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 489/992] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/role_assignments?user.id=1fdb302d62da4b2b8e6c238e11d08f62&scope.project.id=e576abf81756447c87069069c29d7003&role.id=2f26d507b4734a358b054793154a11cb => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:16.241845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057d04-1c91-4b28-962d-513e32040401 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.242133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057d04-1c91-4b28-962d-513e32040401 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.242409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057d04-1c91-4b28-962d-513e32040401 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.243867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 490/993] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:16.251004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.251285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.251591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.270446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:16.271704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:16.284378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4f57-91bc-45b8-9774-5fad0167c264 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.312993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.323713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.324424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.324659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.324937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.325654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.325958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.327974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.333633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 504/994] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:16.339569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.364466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 491/995] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:16.388571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.444577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.448193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbd79-6f49-4a5e-8c40-068d17450931 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.485393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.486342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.486813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.487089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.487833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.488140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.489508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.494203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08659e79-2945-48cd-9a90-e99a4385a64d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.494377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 505/996] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:16.500633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.536817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.537710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.537990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.538324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.539017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.540450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:16.552960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:16.553968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:16.554825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 492/997] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:16.559821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.563291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.611316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41248e2-fca3-497d-8b9f-2ee05be10960 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.645898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.646517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.646754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.647028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.647848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] RBAC: Adding query filter params (interface=public, service_id=b63dbcb4e8074e7ab4ec2d45cad84f0d, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.648152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.649511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.658818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 506/998] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/endpoints?service_id=b63dbcb4e8074e7ab4ec2d45cad84f0d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:16.659827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.672290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140e09-5808-4d11-a4e7-ff78ddaf625a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.689889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.710119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.710772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.711051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.711321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.712305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.712607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.713985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.723709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 493/999] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:16.724878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.764979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab569-6a10-423b-830d-8f0ec44bb57f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.782104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:16.799847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.800627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.801005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.801375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.802151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.803643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.810178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 507/1000] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 05:54:16.831132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c74b3-df17-453c-abc2-40a20d992a71 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:16.869355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:16.870031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:16.870312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:16.870585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:16.871306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:16.871643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:16.873036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236bb16-0e14-49a6-844d-e80749e36b37 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:16.884995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 494/1001] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Jun 22 05:54:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:16.886139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:16.996195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c267-db68-4d17-a026-458d28a78146 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:17.030788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:17.031438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:17.031744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:17.032020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:17.032752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:17.034139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a23ef-5e92-40de-a1f1-ca3906bbf62f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:17.051422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 508/1002] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:18.330834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc12-ec11-42f2-9878-0b6217d7e136 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.331369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc12-ec11-42f2-9878-0b6217d7e136 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.331450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc12-ec11-42f2-9878-0b6217d7e136 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.332966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 495/1003] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:18.338265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.338634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.338821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.356259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:18.357464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:18.392720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:18.432194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 509/1004] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:18.455625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cc12-ec11-42f2-9878-0b6217d7e136 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:18.505353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:18.566911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cc12-ec11-42f2-9878-0b6217d7e136 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:18.600148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:18.600920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.601203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.601478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] PATH_INFO: `/v3/services/image` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.602116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:18.603492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:18.615074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:18.616279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:18.621882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 496/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 22 05:54:18 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:18.624839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:18.724942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac2162-19e3-4f93-9581-1339a13cd14e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:18.758856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:18.759439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.759750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.760030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.760738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:18.761044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:18.762412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba63102-2675-439c-b3c8-6172fe39b0b7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:18.772426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 510/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:18.773680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:18.850177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05f24-154c-4f3e-b5ee-e41e77c8371f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.850460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05f24-154c-4f3e-b5ee-e41e77c8371f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.850737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab05f24-154c-4f3e-b5ee-e41e77c8371f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.852142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 511/1007] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:18.858246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4563c-275b-47e2-b09e-4f9e39a80d3e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.858692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4563c-275b-47e2-b09e-4f9e39a80d3e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.858970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4563c-275b-47e2-b09e-4f9e39a80d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.877269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-64f4563c-275b-47e2-b09e-4f9e39a80d3e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:18.878448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-64f4563c-275b-47e2-b09e-4f9e39a80d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:18.885617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e517-fb05-483b-ae05-1f6a1c9989ce None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:18.894757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:18.905121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:18.921691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:18.922344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:18.922624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:18.922900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:18.923637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] RBAC: Adding query filter params (type=image) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:18.923940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:18.925295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:18.929963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 497/1008] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:18.950339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 512/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:18.973487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.083414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bf0fe-1114-4047-a795-5a08ffe8fa37 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.110443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc445-a5b6-4261-b367-d6c84a86f75f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.110745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc445-a5b6-4261-b367-d6c84a86f75f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.110976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc445-a5b6-4261-b367-d6c84a86f75f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.112738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 513/1010] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:19.117887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.118177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.118459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.124545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.125334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.125616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.125889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.126543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.127934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.135229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:19.136524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:19.140559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:19.146482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:19.147352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 498/1011] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:19.148288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.184129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:19.220110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 514/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:19.243253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.262584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a70b-289a-470f-bec6-9ac2c4788d98 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.301562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.302741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.303090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.303370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.304173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:19.304463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.306087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.313811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 499/1013] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:19.319240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.337197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:19.346731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f9c2-ff13-4915-8bdb-c14058ff2234 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.382747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.383563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.383855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.384148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.385300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.386738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.388629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 515/1014] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:19.394812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.424954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:19.428330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ecd70-50e7-40c8-8116-d46cc9d867b2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.466930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.467708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.468074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.468418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.469182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:19.469549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.470965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.481336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 500/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Jun 22 05:54:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:19.482245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:19.502613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ba0f3-21ff-4b77-bc30-9584d66231de None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.537746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.538393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.538723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.539001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.539725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.541139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa4c2-4cd1-4c81-9061-f4ea230c30e9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.570541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 516/1016] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:19 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:19.589776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199847-f7aa-4d83-8805-a54ab27a0933 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:19.628200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:19.628871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:19.629151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:19.629423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:19.630172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:19.631575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829b7e0-d237-4252-a038-6ce05bcbc456 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:19.659546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 501/1017] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:21.020113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07752a-3588-4cb3-ac43-0b4ed3b41a74 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:21.020632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07752a-3588-4cb3-ac43-0b4ed3b41a74 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:21.020712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07752a-3588-4cb3-ac43-0b4ed3b41a74 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:21.022072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 517/1018] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:21.027040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947071af-d74b-4309-9812-d8ecae25fc94 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:21.027417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947071af-d74b-4309-9812-d8ecae25fc94 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:21.027616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947071af-d74b-4309-9812-d8ecae25fc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:21.045589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-947071af-d74b-4309-9812-d8ecae25fc94 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:21.046746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-947071af-d74b-4309-9812-d8ecae25fc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:21.061874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:21.125271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 502/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:21.147739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07752a-3588-4cb3-ac43-0b4ed3b41a74 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:21.163875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:21.265438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07752a-3588-4cb3-ac43-0b4ed3b41a74 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:21.298215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:21.299113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:21.299633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:21.300117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:21.301036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:21.302593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e42ad-0603-4522-8319-ca9be8878a87 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:21.317178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 518/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:21 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:21.949419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f65b-faf4-47a1-9aaa-c8f1a7a873ca None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:21.949795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f65b-faf4-47a1-9aaa-c8f1a7a873ca None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:21.949987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f65b-faf4-47a1-9aaa-c8f1a7a873ca None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:21.951414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 503/1021] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:21.956619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:21.956978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:21.957326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:21.974690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:21.975884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:22.041149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:22.042472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677c4-7183-4caf-8bb1-fe2397a48450 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.042472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677c4-7183-4caf-8bb1-fe2397a48450 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.042942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677c4-7183-4caf-8bb1-fe2397a48450 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.044475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 504/1022] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:22.050100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.050382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.050665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.052860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 519/1023] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:22.068531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:22.069717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:22.078161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.140582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 505/1024] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:22.164712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.180554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d32ef-baa0-4ef6-8a96-d0b545f65f21 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.226684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.227438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.227827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.227990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.229193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:22.230627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:22.235557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 520/1025] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:22.238950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.253087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:22.279592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaea1a-78d3-4f5c-bb25-61fc39b44ef2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.311416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:22.314511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.315368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.315692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.315971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.326800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:22.334971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:22.335927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:22.340290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 506/1026] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:22.342838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.356474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79072ef5-49db-445b-8e5b-39e48e792aa7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.397183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.397959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.398251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.398521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.399229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:22.400692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:22.431612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 521/1027] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:54:22 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:22.459833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd08ee-7846-4c3b-89b3-8410fead5bac None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.497855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.498449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.498734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.499011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.499820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:22.500130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:22.501527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:22.504283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:22.512038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 507/1028] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:22.517914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.630595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8fa1-88c6-4104-93e3-5da988a1bcdd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.655657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:22.669605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.670406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.670689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.670964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.681675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:22.683114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:22.700003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:22.701628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:22.702864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:22.702864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:22.702864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:22.702864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:22.702864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 522/1029] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:22.707401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.806538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753d5c-514d-4573-aa9e-e27750927107 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:22.840329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:22.840985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:22.841266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:22.842077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:22.842804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:22.843112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:22.844512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:22.855893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 508/1030] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:22.861569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:22.963676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8e0e-3332-4d0d-9235-d0018d14d59d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.003943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.005087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.005598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.006075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.014477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.016209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:23.030240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:23.031348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:23.037370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 523/1031] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:54:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:23.039207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.101980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.146692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0de9c-4f03-4ecf-9ff6-10ad202cde90 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.180142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.180796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.181073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.181343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.182165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:23.182467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.183900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda430e8-4d68-434e-8a37-c53b5f4287d9 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.202268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 509/1032] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:23.207861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.252105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.324550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b936fa-da19-462a-b0c0-25657bd6752d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.356897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.358076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.358359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.358636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.416009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fdcd-481c-4498-b91d-5a773405a3c0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.416362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fdcd-481c-4498-b91d-5a773405a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.416592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fdcd-481c-4498-b91d-5a773405a3c0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.417975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 510/1033] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:23.423409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.423724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.424090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.433768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.436230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.440723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:23.441996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:23.469743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.514145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 511/1034] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:23.536889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.538745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 524/1035] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 05:54:23.544461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.585665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.650103 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e9dc-607f-4c59-9ae1-b4af5af4f6f5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.656642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c3f5-e2aa-477f-a9eb-536411e5db5e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.687376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.688190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.688474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.688742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] PATH_INFO: `/v3/services/image` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.689384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.690731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.693385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.694160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.694442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.694721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.696757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:23.703377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:23.704514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:23.705353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 512/1036] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:23.709117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.710455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.710665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:23.730050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:23.730953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:23.731908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:23.731908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:23.731908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:23.731908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:23.737922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 525/1037] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:23.739159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.813640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0f903-c538-47f3-b693-0b4344216ac3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.823680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.846345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3306-c080-4f71-84d0-613c4d061624 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:23.847808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.848524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.848810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.849087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.849781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] RBAC: Adding query filter params (name=image) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:23.850085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.851424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.856548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 513/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:23.862663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.881496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:23.882149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:23.882430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:23.882706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:23.883418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:23.883752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:23.885123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:23.901119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 526/1039] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:23.902088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:23.952500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:23.978114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d4dce-360a-4deb-b29d-ff81c48e532b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.011394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2192-4b7c-471c-a522-88758d017fa7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.014089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.014753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.015036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.015314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.016044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] RBAC: Adding query filter params (type=image) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:24.016348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.017702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.023425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 514/1040] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:24.029823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.047171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.048147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.048429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.048701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.058815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.061044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.070907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:24.078820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:24.079845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:24.080845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 527/1041] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:24.085830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.139815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1f1b-5828-473a-92fa-cc42c23d332a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.175591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.176101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.176642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.176642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.177487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] RBAC: Adding query filter params (interface=public, service_id=cd4d70e9460542c69d6efbc6540318ad, region_id=RegionOne) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:24.177752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.179082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.188937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 515/1042] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/endpoints?service_id=cd4d70e9460542c69d6efbc6540318ad&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:24.190139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.192992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09df4-11ea-4236-9b61-9ab3eec4cc41 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.202150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:24.235991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883781-69f0-4814-9271-7225138b0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.236681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883781-69f0-4814-9271-7225138b0448 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.236920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883781-69f0-4814-9271-7225138b0448 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.237196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48883781-69f0-4814-9271-7225138b0448 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.237976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883781-69f0-4814-9271-7225138b0448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:24.238281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883781-69f0-4814-9271-7225138b0448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.239722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48883781-69f0-4814-9271-7225138b0448 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.256451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 528/1043] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:24.257504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883781-69f0-4814-9271-7225138b0448 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.304029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69f4d7-b367-4d64-bf9b-90f2e8698df7 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.306024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:24.345136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.345919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.346121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.346394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.347135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.348461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f16b-276a-4788-ae26-79cc9f301d6a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.363536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 516/1044] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 05:54:24.374208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48883781-69f0-4814-9271-7225138b0448 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.412718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.413395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.413677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.413950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.414801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] RBAC: Adding query filter params (role.id=2f26d507b4734a358b054793154a11cb, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:24.415111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:24.416613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df978-2799-434f-b7c4-33dd521d1623 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:24.423409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 529/1045] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=2f26d507b4734a358b054793154a11cb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:24.587980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e8fe-62bc-40e6-80ec-aa4983b732b5 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.588190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e8fe-62bc-40e6-80ec-aa4983b732b5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.588469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e8fe-62bc-40e6-80ec-aa4983b732b5 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.589861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 517/1046] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:24.595100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.595395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.595711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.612372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:24.613556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:24.639107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:24.683577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 530/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:24.708071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98e8fe-62bc-40e6-80ec-aa4983b732b5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.814017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98e8fe-62bc-40e6-80ec-aa4983b732b5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:24.849647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:24.850353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:24.850635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:24.850915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:24.862062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:24.869625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:24.870582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:24.871685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 518/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:24.877416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:24.976019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddfe4d-22dd-4119-9ce3-4d6a797ea94b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:25.010894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:25.011729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:25.012106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:25.012474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:25.013335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:25.013735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:25.015191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:25.027866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 531/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:25.029025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:25.057847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:25.131933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a285-8423-47a3-93e9-9d60d581751d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:25.166459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:25.167308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:25.167612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:25.167882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] PATH_INFO: `/v3/users/b0c0a441fc95400eaf4f15c0e23cf240` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:25.181523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] RBAC: Authorizing `identity:get_user(user_id=b0c0a441fc95400eaf4f15c0e23cf240)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:25.182947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:25.184790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 519/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:25 2022] GET /identity/v3/users/b0c0a441fc95400eaf4f15c0e23cf240 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:25.190485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:25.224641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:25.298563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8cb3-d54c-46fb-bc38-ff824aad8671 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:25.330107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:25.330742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:25.331021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:25.331289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:25.399588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:25.400952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:25.424059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:25.506045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 532/1051] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:25.507305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:25.592457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:25.609847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339deb-fda7-4aba-bcd5-32be1833868b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:25.643123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:25.643992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:25.644270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:25.644540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:25.645691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:25.647092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41a5dd-2c74-4ecb-89ad-78e6266d54e8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:25.653712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 520/1052] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:25 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:25.654890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:25.751593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909afba6-9584-4611-936c-2e3517f96ba2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:25.772950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:25.784928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:25.785562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:25.785837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:25.786107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:25.786923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=5836eb9eeb684a909ebd56014f3616df, user.id=b0c0a441fc95400eaf4f15c0e23cf240) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:25.787229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:25.788667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216ae3c-f342-4644-adcd-8203518e704b None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:25.794250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 533/1053] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:25 2022] GET /identity/v3/role_assignments?user.id=b0c0a441fc95400eaf4f15c0e23cf240&scope.project.id=5836eb9eeb684a909ebd56014f3616df&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:26.425383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64c89-9092-486e-9e99-8a85d051e667 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.425895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64c89-9092-486e-9e99-8a85d051e667 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.425973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64c89-9092-486e-9e99-8a85d051e667 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.427327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 521/1054] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:26.432382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.432754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.432925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.449315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:26.450480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:26.491007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563319d9-84b3-432d-9002-d9cc49bc6269 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.491303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563319d9-84b3-432d-9002-d9cc49bc6269 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.491720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563319d9-84b3-432d-9002-d9cc49bc6269 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.493166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 522/1055] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:26.498416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.498700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.498977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.515629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:26.516791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:26.524684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 534/1056] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:26.547745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.581764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 523/1057] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:26.604832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.649454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4624357-b438-40a0-8a34-cb201f5d48d3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:26.667362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:26.686740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:26.687543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.687840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.688117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] PATH_INFO: `/v3/services/image` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.688772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:26.690140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:26.691996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:26.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:26.703580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:26.704450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 535/1058] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:26.709436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.715811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33cec5-0e57-44a9-8ac5-2ec23bcf2e95 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:26.755385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:26.756131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.756408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.756677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.768041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:26.776033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:26.776996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:26.777868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 524/1059] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:26.783138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.814049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb422-9ddd-4919-abe1-d83ecf5f941e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:26.850666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:26.851486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.851867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.852226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.853030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] RBAC: Adding query filter params (name=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:26.853345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:26.854712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:26.860634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 536/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:26.866394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.895852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19628f42-0fd6-4f1e-81f1-ec8390a6910d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:26.915399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:26.932726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:26.933381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:26.933666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:26.933942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:26.934686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:26.935551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:26.936924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:26.949656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 525/1061] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:26.950657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:26.955365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:26.976973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d547-b28e-4418-b0cb-b85c8a3da8cd None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.015446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.016177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.016463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.016745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.017461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] RBAC: Adding query filter params (type=image) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:27.017770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.019143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.024981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 537/1062] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:27.030343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.055063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54422ab-07d2-4d63-a108-b293e6c62d58 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.090319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.091090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.091380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.091676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.104466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.106150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:27.124460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:27.125343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:27.126280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:27.126280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:27.126280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:27.126280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:27.126280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 526/1063] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:27.131145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.137897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdb855-7637-4a03-957c-600b7a048986 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.147074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:27.173066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.173722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.174006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.174582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.175009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.176395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.190191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:27.203544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 538/1064] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:54:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:27.243182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1fcef-8c6b-4790-b26e-57fc83d226fe None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.285447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.286026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.286306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.286578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.287301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:27.287656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.289031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.302193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 527/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:27.308119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.420778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce7bd-3a18-4123-a435-f4ed2987efd1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.456722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.457508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.457780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.458050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.465949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.467951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:27.481751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:27.483410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:27.484864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 539/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:27.491622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.591047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ecf8-e953-485b-8284-6dfa45341ebb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.604681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:27.627657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.628740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.629207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.629632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.630607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:27.631118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.632722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a99c5-228c-4009-b720-0eb4f6f9b2c7 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.655269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 528/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:27.656677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.683234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:27.760888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f881-48db-48f2-92a9-b91433e5cc98 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.794112 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.795444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.795752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.796029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.806706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.808185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.809018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d82b7-1581-4964-bebe-38d22f2fd06c None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.809307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d82b7-1581-4964-bebe-38d22f2fd06c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.809579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d82b7-1581-4964-bebe-38d22f2fd06c None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.811542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 529/1068] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:27.815858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.816208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.816490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:27.827204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:27.828139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:27.829106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:27.829106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:27.829106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:27.829106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:27.829106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 540/1069] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:27.835474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:27.835706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.836930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:27.903034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 530/1070] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:27.917826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:27.925821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:27.942543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e9a6c-f492-47dc-92c0-324b53f93b0a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:27.979232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:27.979917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:27.980198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:27.980472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:27.981180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:27.981483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:27.983389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:27.995357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 541/1071] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:28.001395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.033908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.036806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40cb91-65de-4815-83bf-7608d2664271 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.076886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.077655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.077932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.078201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.088693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:28.096191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:28.097137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:28.098018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 531/1072] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:28.103377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.111556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d9849-097a-4a4c-a6d4-297adfda7be9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.148617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.149391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.149670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.149939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.152903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.158320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.160247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:28.174911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:28.175838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:28.176779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 542/1073] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:28.182464 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.216772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156ab90-7c6c-4688-a900-3cb0c6aeaf30 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.253426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.254079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.254358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.254633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.255368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:28.255700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.257040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.270041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 532/1074] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:28.270904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.296214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.298832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472a9b-3e97-4132-84b0-a17ee3004ea2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.336944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.337605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.338060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.338271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.339361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:28.339480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.340929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.361582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 543/1075] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:28.363367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.374844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf962b-8ca6-4878-aaf1-93fafc1dd73a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.408310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.409213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.409447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.409725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] PATH_INFO: `/v3/users/b0c0a441fc95400eaf4f15c0e23cf240` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.410934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] RBAC: Authorizing `identity:get_user(user_id=b0c0a441fc95400eaf4f15c0e23cf240)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.412381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.414180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 533/1076] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:28 2022] GET /identity/v3/users/b0c0a441fc95400eaf4f15c0e23cf240 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:28.420428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.430019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.476930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4c5f0-46bf-4193-b2a8-86d1fb326705 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.512140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.513218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.514606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.514917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.515391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/2f26d507b4734a358b054793154a11cb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.517726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=217be31925ad4d859522dce86af2ca45, role_id=2f26d507b4734a358b054793154a11cb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.519170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.525225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb7c9-b4bc-49da-98d1-6f302245752d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.531958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 544/1077] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:54:28 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/217be31925ad4d859522dce86af2ca45/roles/2f26d507b4734a358b054793154a11cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:54:28.570841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.571760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.572040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.572310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.573505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.574941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858e81-7572-4a4a-8904-7198290eddca None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.576931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 534/1078] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:28 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:28.583014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:28.688404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9526-300d-4e29-bbc5-9d06f2139937 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:28.705441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:28.725653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:28.726875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:28.727361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:28.727907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df/users/b0c0a441fc95400eaf4f15c0e23cf240/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:28.730077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5836eb9eeb684a909ebd56014f3616df, user_id=b0c0a441fc95400eaf4f15c0e23cf240, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:28.732443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cc228-2609-474e-be0c-0b4b92e3b4e8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:28.747058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 545/1079] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:54:28 2022] PUT /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df/users/b0c0a441fc95400eaf4f15c0e23cf240/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:54:29.306993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcd36-866f-47fa-946a-0ecfae5c1488 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:29.307327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcd36-866f-47fa-946a-0ecfae5c1488 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:29.307638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcd36-866f-47fa-946a-0ecfae5c1488 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:29.309130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 535/1080] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:29.314041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:29.314340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:29.314621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:29.331758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:29.332933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:29.404790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 546/1081] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:29.426929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edcd36-866f-47fa-946a-0ecfae5c1488 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:29.532061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edcd36-866f-47fa-946a-0ecfae5c1488 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:29.566667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:29.567296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:29.567609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:29.567883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:29.593794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:29.635642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:29.637164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:29.736147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 536/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:29.741859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:29.838345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e000-5c86-4b86-96a9-3ebb1165e7d6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:29.845956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:29.876602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:29.877379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:29.877658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:29.877930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:29.887718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:29.889175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-40c27d98-05f1-450d-bc0c-63012764ee74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:29.907179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:29.908116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:29.909019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:29.909019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:29.909019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:29.909019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:29.909019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 547/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:29.916116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:29.973554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:30.015416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e33a8-62cf-4735-9d07-4aac7fd7ca10 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:30.050277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29932608-5363-4de6-b002-257245fc7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:30.050925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932608-5363-4de6-b002-257245fc7913 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.051206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932608-5363-4de6-b002-257245fc7913 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.051483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29932608-5363-4de6-b002-257245fc7913 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.052257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29932608-5363-4de6-b002-257245fc7913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:30.052523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29932608-5363-4de6-b002-257245fc7913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:30.054170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29932608-5363-4de6-b002-257245fc7913 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:30.065922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 537/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:30.581150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c91f-fa3b-4713-a858-996fbadebd4a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.581362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c91f-fa3b-4713-a858-996fbadebd4a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.581639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1c91f-fa3b-4713-a858-996fbadebd4a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.583036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 548/1085] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:30.589500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b256c-c8e7-4b0a-b06e-3d34614eec87 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.589941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b256c-c8e7-4b0a-b06e-3d34614eec87 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.590059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b256c-c8e7-4b0a-b06e-3d34614eec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.607010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-416b256c-c8e7-4b0a-b06e-3d34614eec87 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:30.608212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-416b256c-c8e7-4b0a-b06e-3d34614eec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:30.676536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 538/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:30.700345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c91f-fa3b-4713-a858-996fbadebd4a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:30.783867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb996-1fec-4849-9ff3-ac4106ceabbc None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.784151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb996-1fec-4849-9ff3-ac4106ceabbc None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.784439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb996-1fec-4849-9ff3-ac4106ceabbc None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.785825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 539/1087] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:54:30.790718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.791003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.791277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.798589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1c91f-fa3b-4713-a858-996fbadebd4a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:30.807519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:30.808700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:30.833347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:30.834072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.834402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.834681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.844851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:30.851757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:30.852716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:30.853691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:30.854550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 549/1088] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Jun 22 05:54:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:30.860332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:30.876714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 540/1089] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:54:30.879313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:30.900493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:30.961154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b10560-3bc1-4484-a4a6-0ea5ece847c3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:30.993251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:30.993902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:30.994179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:30.994444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:30.995171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:30.995468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:30.996002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d916c-42e5-42cd-97ca-145930ffcc51 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:30.996843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.004986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 550/1090] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.010553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.030442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.031221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.031530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.031810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.042192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:31.049774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:31.050895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:31.052016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 541/1091] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:31.056923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.094094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.096966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.113271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639f252-8510-44ff-9ac6-40441415a5d4 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.146612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.147390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.147695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.147971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.155572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198141b-6a4b-4272-87c1-566ae912a4e2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.158159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.159632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:31.176557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:31.177452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:31.178502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:31.178502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:31.178502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:31.178502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:31.178502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 551/1092] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:31.183333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.191360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.192059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.192347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.192629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.193373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:31.193683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.195037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.203101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 542/1093] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:31.209083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.281374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1376f-2f6e-4627-8c66-a431a85baf63 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.306222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.309501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503e9fa-9d5f-4aeb-bad3-5a75ba4043b4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.310914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.316049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.316705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.316994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.317269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.317984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:31.318289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.319684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.331175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 552/1094] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.336886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.344898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.345688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.345972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.346254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] PATH_INFO: `/v3/users/b0c0a441fc95400eaf4f15c0e23cf240` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.347443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] RBAC: Authorizing `identity:get_user(user_id=b0c0a441fc95400eaf4f15c0e23cf240)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.348887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.355011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 543/1095] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/users/b0c0a441fc95400eaf4f15c0e23cf240 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.355919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.435558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9642-d439-4a6e-bc8f-d7877f0c7929 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.457502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f465-1567-465c-bad9-00cd3a5efe8b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.468893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.469664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.469943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.470214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.477023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.478447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.490943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.491607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.491891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.492164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:54:31.492847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:31.493781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:31.494734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 553/1096] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:31.500358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.527434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.551547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.560663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.562102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.598325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef20b0-7d3b-42b3-aaf8-7dcc0bd7028f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.631479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.632578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.632578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.632768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.633523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:31.633831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.635323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.651777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 554/1097] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.657790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.667186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 544/1098] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:31.673557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.737646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.753650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872754e3-9dac-4f5e-ab4a-c9cd92cf8665 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.763796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.770711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5401-7f5e-4a55-8857-63b7408910d8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.787350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.788015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.788290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.788560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.804666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.805503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.805790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.806065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.807230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.808691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.810390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 545/1099] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.816174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.853548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.854931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.912323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd1ef1-4ae5-4f68-a1ff-12e2d6a10bad None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:31.945888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:31.946539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:31.946819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:31.947094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:31.947942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=5836eb9eeb684a909ebd56014f3616df, user.id=b0c0a441fc95400eaf4f15c0e23cf240) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:31.948248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:31.949645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:31.950094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 555/1100] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 05:54:31.953129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:31.956186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:31.956856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 546/1101] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/role_assignments?user.id=b0c0a441fc95400eaf4f15c0e23cf240&scope.project.id=5836eb9eeb684a909ebd56014f3616df&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:31.968518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:32.060713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a438b77-40e6-4ee1-96c2-bdc64ae13ef7 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:32.096947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:32.097747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:32.098027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:32.098306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:32.109215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:32.110669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:32.129154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:32.130235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:32.131157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:54:32.131157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:32.131157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:54:32.131157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:32.131157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 556/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:54:32.136501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:32.237094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17346fd-a111-4b6e-807b-0a78596e452e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:32.270237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:32.270885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:32.271169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:32.271446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:32.272194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:32.272501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:32.273856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:32.285505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 547/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:32.290921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:32.356462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:32.393769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2047cc-66e7-4c52-aa38-4f1c423466f2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:32.427659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:32.428438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:32.428722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:32.428995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:32.435642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:32.437086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:54:32.450533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:32.451610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:32.452559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 557/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:32.457524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:32.516888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:32.557776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fde3c3-afa7-458f-a255-77216c6838d5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:32.590206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:32.591345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:32.591670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:32.591948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:32.592902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:32.593222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:32.594651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff0b2-9caf-4e53-a4cd-31145c543f2a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:32.605921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 548/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:32.612510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:32.714963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08d98b-3e6c-4ea9-a745-1b588f28a721 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:32.736363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:32.747809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:32.748453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:32.748733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:32.749007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:32.749828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] RBAC: Adding query filter params (role.id=2f26d507b4734a358b054793154a11cb, scope.project.id=e576abf81756447c87069069c29d7003, user.id=217be31925ad4d859522dce86af2ca45) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:32.750137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:32.751578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024b6a6-18db-4860-b5b5-14d652254155 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:32.757214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 558/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:32 2022] GET /identity/v3/role_assignments?user.id=217be31925ad4d859522dce86af2ca45&scope.project.id=e576abf81756447c87069069c29d7003&role.id=2f26d507b4734a358b054793154a11cb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:34.008397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298f-0428-4518-8221-722c99854b45 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:34.008919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298f-0428-4518-8221-722c99854b45 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:34.009008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298f-0428-4518-8221-722c99854b45 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:34.010305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 549/1107] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:34.015893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:34.016301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:34.016446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:34.032642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:34.033810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:34.097897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 559/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:34.121947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f298f-0428-4518-8221-722c99854b45 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:34.220497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f298f-0428-4518-8221-722c99854b45 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:34.241021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:34.255179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:34.255977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:34.256259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:34.256533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:34.257688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:34.259151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd35f-82aa-4dfe-8f31-b4e3e9098da2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:34.260759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 550/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:34.266378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:34.365080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823290-bb5f-4735-855c-71ff85af96c9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:34.380902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:34.397749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:34.398395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:34.398674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:34.398945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:34.399673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:34.401095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457a141-3308-4c2e-80c7-9c28dbff6f71 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:34.419956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 560/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:54:34 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:36.504668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80dd59-ad56-4a1d-a287-b5e8a86c2e96 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:36.505168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80dd59-ad56-4a1d-a287-b5e8a86c2e96 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:36.505168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80dd59-ad56-4a1d-a287-b5e8a86c2e96 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:36.506504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 551/1111] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:36.511925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:36.512374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:36.513009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:36.530323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:36.531938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:36.606777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 561/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:36.631272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80dd59-ad56-4a1d-a287-b5e8a86c2e96 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:36.733849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80dd59-ad56-4a1d-a287-b5e8a86c2e96 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:36.767270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:36.768084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:36.768369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:36.768670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] PATH_INFO: `/v3/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:36.770134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] RBAC: Authorizing `identity:get_role(role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:36.771491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:36.772900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 552/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:36 2022] GET /identity/v3/roles/792bbf94ba3642c79d76ead64a6b33be => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:36.779379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:36.883252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efd57-c89e-46e0-9a29-0d12c3a8dc7e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:36.884875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:36.920404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:36.921265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:36.921548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:36.921821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] PATH_INFO: `/v3/users/ef587cf31c1748a38a879b8d1cfdea4e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:36.936528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] RBAC: Authorizing `identity:get_user(user_id=ef587cf31c1748a38a879b8d1cfdea4e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:36.937961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:36.939662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 562/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:36 2022] GET /identity/v3/users/ef587cf31c1748a38a879b8d1cfdea4e => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:36.945631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:37.000963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:37.044578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d0979-eaff-4d9c-8e70-e6cfb425c5ff None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:37.089478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:37.090112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:37.090391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:37.090810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:37.155078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:37.156530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:37.207623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:37.251541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 553/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:37.257462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:37.352527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de4d7c-8176-4fef-b3d4-420949b7d698 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:37.386912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:37.387932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:37.388105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:37.388388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:37.389567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:37.390989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca14f-6464-4fd8-8bdd-d74ac200205c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:37.392718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 563/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:37 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:37.400233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:37.494026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c4a4-f957-4522-88b9-77cd377d5eb8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:37.526248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:37.526876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:37.527153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:37.527425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:37.528292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=5836eb9eeb684a909ebd56014f3616df, user.id=ef587cf31c1748a38a879b8d1cfdea4e) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:37.528601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:37.530011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabef0d-c473-46ee-a551-36974a90fa0e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:37.535215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 554/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:37 2022] GET /identity/v3/role_assignments?user.id=ef587cf31c1748a38a879b8d1cfdea4e&scope.project.id=5836eb9eeb684a909ebd56014f3616df&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:39.545954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e1810-7c0a-4e30-a7e6-7b5e2db02db9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:39.546462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e1810-7c0a-4e30-a7e6-7b5e2db02db9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:39.546462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e1810-7c0a-4e30-a7e6-7b5e2db02db9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:39.547863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 564/1118] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:39.553202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:39.553628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:39.553759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:39.569992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:39.571171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:39.585207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:39.637852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 555/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:39.661581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e1810-7c0a-4e30-a7e6-7b5e2db02db9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:39.688599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:39.757947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e1810-7c0a-4e30-a7e6-7b5e2db02db9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:39.790302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:39.791132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:39.791413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:39.791717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] PATH_INFO: `/v3/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:39.793164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] RBAC: Authorizing `identity:get_role(role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:39.794553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:39.795947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 565/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:39 2022] GET /identity/v3/roles/792bbf94ba3642c79d76ead64a6b33be => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:39.801697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:39.895914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c4ac-0073-4742-bfa0-39c39d49f32a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:39.928460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:39.929308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:39.929591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:39.929867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] PATH_INFO: `/v3/users/ef587cf31c1748a38a879b8d1cfdea4e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:39.931036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] RBAC: Authorizing `identity:get_user(user_id=ef587cf31c1748a38a879b8d1cfdea4e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:39.932483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:39.934094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 556/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:39 2022] GET /identity/v3/users/ef587cf31c1748a38a879b8d1cfdea4e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:39.940396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:40.028856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:40.034978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc50ae-30fe-4e8a-b475-308ba1bb217c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:40.066758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:40.067553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:40.067834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:40.068104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:40.069239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:40.070652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979359-203d-40fc-9935-8b334d4d3cdb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:40.072336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 566/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:39 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:40.078563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:40.097032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:40.174783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a806a-c7bf-4257-b9e2-fd48f42b70e5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:40.207396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7159-e028-4475-a108-14270f040708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:40.208288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7159-e028-4475-a108-14270f040708 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:40.208572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7159-e028-4475-a108-14270f040708 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:40.208852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7159-e028-4475-a108-14270f040708 None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df/users/ef587cf31c1748a38a879b8d1cfdea4e/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:40.211049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7159-e028-4475-a108-14270f040708 None admin] RBAC: Authorizing `identity:create_grant(project_id=5836eb9eeb684a909ebd56014f3616df, user_id=ef587cf31c1748a38a879b8d1cfdea4e, role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:40.212755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7159-e028-4475-a108-14270f040708 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:40.225557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 557/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:54:40 2022] PUT /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df/users/ef587cf31c1748a38a879b8d1cfdea4e/roles/792bbf94ba3642c79d76ead64a6b33be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:54:42.213214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b38-3212-4292-bf50-f06b1dcbbe97 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:42.213760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b38-3212-4292-bf50-f06b1dcbbe97 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:42.213760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b38-3212-4292-bf50-f06b1dcbbe97 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:42.215118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 567/1124] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:42.220287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:42.220720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:42.220822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:42.237222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:42.238397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:42.301935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 558/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:42.326287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6b38-3212-4292-bf50-f06b1dcbbe97 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:42.422812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6b38-3212-4292-bf50-f06b1dcbbe97 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:42.454976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:42.455838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:42.456120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:42.456393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] PATH_INFO: `/v3/roles/792bbf94ba3642c79d76ead64a6b33be` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:42.457846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] RBAC: Authorizing `identity:get_role(role_id=792bbf94ba3642c79d76ead64a6b33be)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:42.459206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:42.460573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 568/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:42 2022] GET /identity/v3/roles/792bbf94ba3642c79d76ead64a6b33be => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:42.466461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:42.476260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:42.562930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfd4c-79ef-4380-a6bb-99b2bfdaac7d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:42.595172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:42.596043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:42.596329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:42.596604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] PATH_INFO: `/v3/users/ef587cf31c1748a38a879b8d1cfdea4e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:42.597767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] RBAC: Authorizing `identity:get_user(user_id=ef587cf31c1748a38a879b8d1cfdea4e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:42.599186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:42.600834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 559/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:42 2022] GET /identity/v3/users/ef587cf31c1748a38a879b8d1cfdea4e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:42.606967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:42.637032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:42.702827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6497c7-4746-4dd3-8fe2-35b2f1273d28 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:42.735126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:42.735750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:42.736034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:42.736309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:42.799581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:42.801025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:42.829074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:42.894939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 569/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 05:54:42.900851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:42.975216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:42.998403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081deb2c-8092-4463-a52e-3ada13a307cb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:43.031156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:43.032014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:43.032300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:43.032579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] PATH_INFO: `/v3/projects/5836eb9eeb684a909ebd56014f3616df` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:43.033748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] RBAC: Authorizing `identity:get_project(project_id=5836eb9eeb684a909ebd56014f3616df)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:43.035164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784138c9-1962-40b1-88a3-8bfb635f803d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:43.036864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 560/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:42 2022] GET /identity/v3/projects/5836eb9eeb684a909ebd56014f3616df => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:43.042643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:43.136497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae078-597c-4d6e-b997-649f005e5b71 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:43.163964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:43.169512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:43.170145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:43.170421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:43.170689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:43.171520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] RBAC: Adding query filter params (role.id=792bbf94ba3642c79d76ead64a6b33be, scope.project.id=5836eb9eeb684a909ebd56014f3616df, user.id=ef587cf31c1748a38a879b8d1cfdea4e) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:43.171837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:43.173256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fad8-80f4-4d9a-a325-9392d56bdc73 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:43.178866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 570/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:43 2022] GET /identity/v3/role_assignments?user.id=ef587cf31c1748a38a879b8d1cfdea4e&scope.project.id=5836eb9eeb684a909ebd56014f3616df&role.id=792bbf94ba3642c79d76ead64a6b33be => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:45.207050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d549-72a8-44d6-b5d5-f6280470c636 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:45.207594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d549-72a8-44d6-b5d5-f6280470c636 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:45.207711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d549-72a8-44d6-b5d5-f6280470c636 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:45.209023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 561/1131] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:45.214620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:45.215539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:45.215721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:45.232453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:45.233614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:45.296643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 571/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:45.319623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6d549-72a8-44d6-b5d5-f6280470c636 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:45.416250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6d549-72a8-44d6-b5d5-f6280470c636 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:45.448762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:45.450020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:45.450296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:45.450565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:45.451805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:45.453210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f34df-bc79-42f3-b188-0f1a9891e3a3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:45.454794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 562/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:45.460446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:45.553445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953614bd-695e-4424-ade2-079f035ff1a1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:45.577693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:45.586873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:45.587529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:45.587823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:45.588094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:45.588797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:45.590752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab5ce-0808-4e17-a1d5-d68d9366837e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:45.613877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 572/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:54:45 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 05:54:47.641894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b93b-71ed-429e-b359-06f6654cb471 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:47.642418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b93b-71ed-429e-b359-06f6654cb471 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:47.642522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b93b-71ed-429e-b359-06f6654cb471 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:47.643837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 563/1135] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:47.648972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:47.649346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:47.649526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:47.666447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:47.667630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:47.732012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 573/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:47.757693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b93b-71ed-429e-b359-06f6654cb471 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:47.772680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:47.857176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62b93b-71ed-429e-b359-06f6654cb471 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:47.889976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:47.890736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:47.891021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:47.891300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:47.892535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:47.893904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e54fb-12c3-4f98-86da-9ddf7ec6133e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:47.895514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 564/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:54:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:47.901187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:47.994544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ddba9-343b-46f2-a6e5-3c51301d9641 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:48.003352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:48.029199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:48.029841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:48.030120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:48.030395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:48.031088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:48.032543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4c42-b7dc-4ef0-bd14-763fc94c4bbb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:48.053205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 574/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:54:47 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:54:50.089825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451498-0026-44d1-bccc-da35c6937675 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.090388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451498-0026-44d1-bccc-da35c6937675 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.090483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451498-0026-44d1-bccc-da35c6937675 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.091845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 565/1139] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:50.096969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.097381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.097530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.114348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:50.115535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:50.178855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 575/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:50.202465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451498-0026-44d1-bccc-da35c6937675 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:50.281387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:50.301170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451498-0026-44d1-bccc-da35c6937675 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:50.333473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083338-5f17-4073-9722-584f233b5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:50.334240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083338-5f17-4073-9722-584f233b5566 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.334521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083338-5f17-4073-9722-584f233b5566 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.334792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083338-5f17-4073-9722-584f233b5566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.345320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34083338-5f17-4073-9722-584f233b5566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-34083338-5f17-4073-9722-584f233b5566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:50.352761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:50.353969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:50.354922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 566/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:50.360494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:50.448185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:50.455396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df7ff-27a2-4dac-9d1f-77c53ad2ef04 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:50.488824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:50.489477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.489760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.490033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.490769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:50.491073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:50.492457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:50.500181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 576/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:50.505705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083338-5f17-4073-9722-584f233b5566 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:50.601074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083338-5f17-4073-9722-584f233b5566 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:50.632878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:50.633715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.633997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.634273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] PATH_INFO: `/v3/users/ce9ceca716c4437aa8c8a48135c839ac` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.644144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:50.647558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] RBAC: Authorizing `identity:get_user(user_id=ce9ceca716c4437aa8c8a48135c839ac)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:50.648986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:50.650601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 567/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:50 2022] GET /identity/v3/users/ce9ceca716c4437aa8c8a48135c839ac => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:50.656776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:50.751719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca65f-5411-42bf-af4a-bfb1c1c76b60 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:50.783958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:50.784587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:50.784871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:50.785147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:50.808538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:50.850202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:50.851745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:50.943882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 577/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:50.950279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:51.045411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f85af-872b-4f78-a7ca-6ae16b469b7b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:51.078330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:51.079159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:51.079438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:51.079740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] PATH_INFO: `/v3/projects/1602d701a4254d52b403899ff704d596` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:51.080883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] RBAC: Authorizing `identity:get_project(project_id=1602d701a4254d52b403899ff704d596)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:51.082286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555c044-4a56-461f-a75e-eede5077b412 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:51.084036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 568/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:50 2022] GET /identity/v3/projects/1602d701a4254d52b403899ff704d596 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:51.090074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:51.145128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:51.187191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4495b9-416b-4124-a7f1-d5de96b97449 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:51.219761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:51.220412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:51.220693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:51.220967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:51.221794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=1602d701a4254d52b403899ff704d596, user.id=ce9ceca716c4437aa8c8a48135c839ac) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:51.222101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:51.223558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132c3c-0ec4-4828-bccd-51b2c9485c22 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:51.228912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 578/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:51 2022] GET /identity/v3/role_assignments?user.id=ce9ceca716c4437aa8c8a48135c839ac&scope.project.id=1602d701a4254d52b403899ff704d596&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:53.217139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89906-70ed-4d1b-b516-09859066fa75 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.217656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89906-70ed-4d1b-b516-09859066fa75 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.217751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd89906-70ed-4d1b-b516-09859066fa75 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.219055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 569/1147] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:53.224388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.224756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.224936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.241476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:53.242629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:53.304714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 579/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:53.327577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd89906-70ed-4d1b-b516-09859066fa75 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:53.391224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:53.426203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd89906-70ed-4d1b-b516-09859066fa75 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:53.466243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:53.467020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.467353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.467601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.477379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:53.484900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:53.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:53.487074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 570/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:53.492271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:53.543134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:53.591487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c493-df86-4525-aa79-07de16d3f214 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:53.623378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:53.624055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.624336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.624610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.625345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:53.625654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:53.627023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:53.634681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 580/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:53.640980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:53.736885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b061-d8fc-4267-bf9b-e5086f7a7e69 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:53.766051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:53.774658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:53.775523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.775823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.776097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] PATH_INFO: `/v3/users/ce9ceca716c4437aa8c8a48135c839ac` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.777279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] RBAC: Authorizing `identity:get_user(user_id=ce9ceca716c4437aa8c8a48135c839ac)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:53.778699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:53.780358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 571/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:53 2022] GET /identity/v3/users/ce9ceca716c4437aa8c8a48135c839ac => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:53.786108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:53.881121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0926f-2776-4425-882d-72f35e909ba2 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:53.892973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:53.913134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:53.913972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:53.914249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:53.914517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] PATH_INFO: `/v3/projects/1602d701a4254d52b403899ff704d596` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:53.915687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] RBAC: Authorizing `identity:get_project(project_id=1602d701a4254d52b403899ff704d596)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:53.917102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057f0de-ab73-4e86-a74a-e293595c5582 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:53.919285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 581/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:53 2022] GET /identity/v3/projects/1602d701a4254d52b403899ff704d596 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:53.925325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:54.021439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3bf2d-378b-4463-8425-23bc998f5ccb None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:54.053810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:54.054675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:54.054953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:54.055223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] PATH_INFO: `/v3/projects/1602d701a4254d52b403899ff704d596/users/ce9ceca716c4437aa8c8a48135c839ac/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:54.057162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] RBAC: Authorizing `identity:create_grant(project_id=1602d701a4254d52b403899ff704d596, user_id=ce9ceca716c4437aa8c8a48135c839ac, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:54.059130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de567e-6f32-48e5-8c02-d6934133d69c None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:54.071669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 572/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:54:53 2022] PUT /identity/v3/projects/1602d701a4254d52b403899ff704d596/users/ce9ceca716c4437aa8c8a48135c839ac/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:54:56.093719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36949d-d550-4086-97fa-1a1e1fb7bc3e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.094316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36949d-d550-4086-97fa-1a1e1fb7bc3e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.094316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36949d-d550-4086-97fa-1a1e1fb7bc3e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.095633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 582/1154] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:56.100719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.101133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.101278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.117547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:56.118709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:56.165806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:56.183575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 573/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:56.207163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36949d-d550-4086-97fa-1a1e1fb7bc3e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:56.304681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36949d-d550-4086-97fa-1a1e1fb7bc3e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:56.336804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:56.337568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.337843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.338115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.348180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:54:56.355598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:56.356681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:54:56.357738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 583/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:56.362707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:56.457846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dadeab-4303-4b73-b2ab-e598a693e766 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:56.490074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36941666-08b5-4295-b74a-442db7165094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:56.490718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941666-08b5-4295-b74a-442db7165094 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.491004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941666-08b5-4295-b74a-442db7165094 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.491283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941666-08b5-4295-b74a-442db7165094 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.492056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36941666-08b5-4295-b74a-442db7165094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:56.492364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36941666-08b5-4295-b74a-442db7165094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:56.493720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36941666-08b5-4295-b74a-442db7165094 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:56.502011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 574/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:54:56.507398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:56.547022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:56.602562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3b04-7a34-458b-970d-fde5f61bb04f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:56.634573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:56.635408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.635711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.635983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] PATH_INFO: `/v3/users/ce9ceca716c4437aa8c8a48135c839ac` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.637670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=ce9ceca716c4437aa8c8a48135c839ac)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:56.639088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:56.640705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 584/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:54:56 2022] GET /identity/v3/users/ce9ceca716c4437aa8c8a48135c839ac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:56.646289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36941666-08b5-4295-b74a-442db7165094 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:56.691966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:56.742848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36941666-08b5-4295-b74a-442db7165094 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:56.774778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:56.775402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:56.775709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:56.775985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:56.839818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:56.841252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:56.884117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:56.936680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 575/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:56.942563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:57.035882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b021c-97bc-460c-b2d3-b92f08557ca9 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:57.045062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:57.069077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:57.069913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:57.070193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:57.070465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] PATH_INFO: `/v3/projects/1602d701a4254d52b403899ff704d596` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:57.071651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] RBAC: Authorizing `identity:get_project(project_id=1602d701a4254d52b403899ff704d596)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:57.073075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0466a-c8ad-4565-b47f-b1a5a76f73dc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:57.074879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 585/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:54:56 2022] GET /identity/v3/projects/1602d701a4254d52b403899ff704d596 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:57.080979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:57.175655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083864-24da-4e40-a4a6-02060c5ad250 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:57.215268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:57.215929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:57.216212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:57.216485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:57.217310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=1602d701a4254d52b403899ff704d596, user.id=ce9ceca716c4437aa8c8a48135c839ac) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:57.217625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:57.219082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3653931-22c1-4423-b50f-67d7513c486f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:57.224908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 576/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:54:57 2022] GET /identity/v3/role_assignments?user.id=ce9ceca716c4437aa8c8a48135c839ac&scope.project.id=1602d701a4254d52b403899ff704d596&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:54:59.231164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688dbc-8d3a-41fe-95ac-1f5bd80c4154 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:59.231576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688dbc-8d3a-41fe-95ac-1f5bd80c4154 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:59.231753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688dbc-8d3a-41fe-95ac-1f5bd80c4154 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:59.233120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 586/1162] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:54:59.238119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:59.238538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:59.238686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:59.254832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:54:59.256040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:54:59.258705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:59.320291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 577/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:54:59.342856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688dbc-8d3a-41fe-95ac-1f5bd80c4154 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:59.439450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688dbc-8d3a-41fe-95ac-1f5bd80c4154 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:59.472935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:59.473497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:59.473776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:59.474049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:59.516716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:59.538390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:59.539858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:59.635826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 587/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:54:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:54:59.642427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:59.735584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfde3a-26c5-4644-b329-02598aaf81e4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:59.768009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:59.768782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:59.769059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:59.769328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:59.775736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:59.777194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:59.779618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-e87844e3-5984-4187-b009-b7e73fd315fe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:54:59.791937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:54:59.793641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:54:59.794834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 578/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:54:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:54:59.799448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:54:59.872170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:54:59.894278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd59f-ee80-4e2f-bbdb-c9cbd8e0a74d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:54:59.926704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:54:59.927342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:54:59.927655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:54:59.927934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:54:59.928639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:54:59.928942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:54:59.930293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679da54-429a-41ea-abeb-3c05b8649587 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:54:59.937897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 588/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Jun 22 05:54:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:01.930536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a673fe-d78b-4ff0-b0de-fee47d3cfe29 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:01.931081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a673fe-d78b-4ff0-b0de-fee47d3cfe29 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:01.931081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a673fe-d78b-4ff0-b0de-fee47d3cfe29 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:01.932490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 579/1167] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:01.938068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef56d-7429-4a92-bc11-c3d80be919c7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:01.938437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef56d-7429-4a92-bc11-c3d80be919c7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:01.938618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ef56d-7429-4a92-bc11-c3d80be919c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:01.954714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-277ef56d-7429-4a92-bc11-c3d80be919c7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:01.955905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-277ef56d-7429-4a92-bc11-c3d80be919c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:02.019013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 589/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:02.041265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a673fe-d78b-4ff0-b0de-fee47d3cfe29 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:02.139840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a673fe-d78b-4ff0-b0de-fee47d3cfe29 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:02.172368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:02.173000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:02.173285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:02.173561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:02.174295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:02.175672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234046-0cc1-4f64-904b-dfcffd84dd69 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:02.190237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 580/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Wed Jun 22 05:55:02 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:55:04.221488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10202ff6-2934-4b33-ac93-fcccbf72a96f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:04.222030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10202ff6-2934-4b33-ac93-fcccbf72a96f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:04.222030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10202ff6-2934-4b33-ac93-fcccbf72a96f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:04.223427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 590/1170] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:04.228514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:04.228908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:04.229070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:04.245237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:04.246398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:04.298545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:04.311617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 581/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:04.336007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10202ff6-2934-4b33-ac93-fcccbf72a96f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:04.403631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:04.433380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10202ff6-2934-4b33-ac93-fcccbf72a96f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:04.466377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:04.467213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:04.467522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:04.467804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] PATH_INFO: `/v3/domains/8803f747b2ca49839559220ed97f5e4e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:04.477808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8803f747b2ca49839559220ed97f5e4e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:04.479201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656cc8-16ae-47f7-97d6-0149c4041538 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:04.480897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 591/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Jun 22 05:55:04 2022] GET /identity/v3/domains/8803f747b2ca49839559220ed97f5e4e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:04.486613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:04.582701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1315-1007-4f55-990e-3b7f8fe05531 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:04.614851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:04.615486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:04.615799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:04.616076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:04.616780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:04.618201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670a5d6-0eb8-4797-ab7c-7476794b78ac None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:04.643244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 582/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:55:04 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:55:06.702298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa426bb-8532-4a35-b574-6b303dd541c0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:06.702841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa426bb-8532-4a35-b574-6b303dd541c0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:06.702841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa426bb-8532-4a35-b574-6b303dd541c0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:06.704237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 592/1174] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:06.709581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:06.710003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:06.710412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:06.726656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:06.727868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:06.762159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:06.793489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 583/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:06.818749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa426bb-8532-4a35-b574-6b303dd541c0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:06.916185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa426bb-8532-4a35-b574-6b303dd541c0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:06.942951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:06.948995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:06.949845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:06.950130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:06.950409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] PATH_INFO: `/v3/domains/8803f747b2ca49839559220ed97f5e4e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:06.951605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8803f747b2ca49839559220ed97f5e4e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:06.953085 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d90f1-e87f-4054-9fcb-002c6ce561f4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:06.954642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 593/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Jun 22 05:55:06 2022] GET /identity/v3/domains/8803f747b2ca49839559220ed97f5e4e => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:06.960483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:07.056196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9a27f-dfdc-4427-86e7-6d1d50d728f6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:07.089259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:07.089905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:07.090186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:07.090459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:07.091154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:07.092599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c8c4b-3750-4e52-8fb4-749045221bd6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:07.112710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 584/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:55:06 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:55:09.159667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79c48-bd69-4d46-8ae1-1681d13d8e1c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.160251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79c48-bd69-4d46-8ae1-1681d13d8e1c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.160251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79c48-bd69-4d46-8ae1-1681d13d8e1c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.161581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 594/1178] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:09.166753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.167196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.167339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.184222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:09.185391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:09.206993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:09.251444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 585/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:09.274851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79c48-bd69-4d46-8ae1-1681d13d8e1c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:09.373208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79c48-bd69-4d46-8ae1-1681d13d8e1c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:09.404723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:09.405485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.405763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.406036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.416157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:55:09.424075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:55:09.425370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:55:09.426296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 595/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:55:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:55:09.431570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:09.529658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bbe3b-1563-4456-8cbb-01942724ab19 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:09.562605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:09.563253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.563726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.564015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.564759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:55:09.565067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:09.566427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:09.574478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 586/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:55:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:09.580365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:09.636067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:09.675641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296631a-0223-4886-a978-586f2d3b9e05 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:09.707817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:09.708667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.708951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.709219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] PATH_INFO: `/v3/users/60ffce8bef3d476bbffcd63b8d84145f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.721736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=60ffce8bef3d476bbffcd63b8d84145f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:09.723157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:09.724787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 596/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:55:09 2022] GET /identity/v3/users/60ffce8bef3d476bbffcd63b8d84145f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:09.730888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:09.752694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:09.832916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814d9b-9840-435a-81bb-e00dc52188aa None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:09.866449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:09.867087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:09.867373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:09.867769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:09.932511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:09.933910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:09.953122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:10.027920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 587/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:55:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:55:10.033799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:10.132555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03cb8c-b6f2-44a1-b1a8-1be45c6e2bf3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:10.154310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:10.172287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:10.173137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:10.173421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:10.173697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] PATH_INFO: `/v3/projects/37f64c4f34ed4d748b613d78e703185e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:10.174857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] RBAC: Authorizing `identity:get_project(project_id=37f64c4f34ed4d748b613d78e703185e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:10.176312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d3d6-b909-470d-95e4-bdfea27d1acb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:10.178007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 597/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:55:10 2022] GET /identity/v3/projects/37f64c4f34ed4d748b613d78e703185e => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:10.184195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:10.279552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d5182-153f-4457-ab9e-b4db0fd20947 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:10.298279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:10.311759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:10.312394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:10.312675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:10.312950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:10.313771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=37f64c4f34ed4d748b613d78e703185e, user.id=60ffce8bef3d476bbffcd63b8d84145f) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:55:10.314081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:10.315491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce72fa8-cfba-4bd9-987f-187b3f647b76 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:10.320748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 588/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:55:10 2022] GET /identity/v3/role_assignments?user.id=60ffce8bef3d476bbffcd63b8d84145f&scope.project.id=37f64c4f34ed4d748b613d78e703185e&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:12.294457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e220d6-7bd5-49bc-93af-d0455d60da7b None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.294996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e220d6-7bd5-49bc-93af-d0455d60da7b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.294996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e220d6-7bd5-49bc-93af-d0455d60da7b None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.296405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 598/1186] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:12.301774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.302184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.302323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.318683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:12.319890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:12.384568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 589/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:12.406869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e220d6-7bd5-49bc-93af-d0455d60da7b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:12.503019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e220d6-7bd5-49bc-93af-d0455d60da7b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:12.535259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:12.536037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.536314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.536581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.546125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:55:12.553555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:55:12.554632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:55:12.555845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 599/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:55:12.560583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:12.655150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc33ab1-b638-4394-8fb6-c162b9d38b40 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:12.668433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:12.687713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:12.688360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.688644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.688920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.689663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:55:12.689969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:12.691313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:12.699609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 590/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:55:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:55:12.705375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:12.748728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:12.800722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570cb1-4a92-425b-ac10-d2bcb86485eb None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:12.832314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:12.833153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.833432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.833703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] PATH_INFO: `/v3/users/60ffce8bef3d476bbffcd63b8d84145f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.834847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] RBAC: Authorizing `identity:get_user(user_id=60ffce8bef3d476bbffcd63b8d84145f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:12.836540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:12.838119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 600/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:55:12 2022] GET /identity/v3/users/60ffce8bef3d476bbffcd63b8d84145f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:12.843732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:12.938828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0459b1-79df-4206-9e54-7dd28731ee3f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:12.970641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:12.971471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:12.971776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:12.972057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] PATH_INFO: `/v3/projects/37f64c4f34ed4d748b613d78e703185e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:12.973209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] RBAC: Authorizing `identity:get_project(project_id=37f64c4f34ed4d748b613d78e703185e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:12.974606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edb528-f72e-42b2-8a4b-d9bcbb9a2219 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:12.976293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 591/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:55:12 2022] GET /identity/v3/projects/37f64c4f34ed4d748b613d78e703185e => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:55:12.981930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:13.077417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213bdde-2a29-43fd-ab08-2afd723f027e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:13.089506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:13.109656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:13.110514 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:13.110792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:13.111062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] PATH_INFO: `/v3/projects/37f64c4f34ed4d748b613d78e703185e/users/60ffce8bef3d476bbffcd63b8d84145f/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:13.113018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=37f64c4f34ed4d748b613d78e703185e, user_id=60ffce8bef3d476bbffcd63b8d84145f, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:13.114436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a0117-5ea7-48b2-88db-81feb6ab44f8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:13.126528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 601/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:55:12 2022] PUT /identity/v3/projects/37f64c4f34ed4d748b613d78e703185e/users/60ffce8bef3d476bbffcd63b8d84145f/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:55:15.123238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4b29-1454-403c-9a1d-fed506e777c4 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.123789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4b29-1454-403c-9a1d-fed506e777c4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.123900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d4b29-1454-403c-9a1d-fed506e777c4 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.125182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 592/1193] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:55:15.130380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.130890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.130987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.147154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:55:15.148370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:55:15.212548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 602/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:55:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:55:15.237041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d4b29-1454-403c-9a1d-fed506e777c4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:15.285464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:15.339799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d4b29-1454-403c-9a1d-fed506e777c4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:15.376518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:15.377230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.377516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.377794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.394595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:55:15.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:55:15.403525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:55:15.404568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 593/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:55:15.409544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:15.502190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792cf53-ce45-4d7c-822a-3ab787a6eb56 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:15.503686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:15.537765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:15.538413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.538690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.538961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.539724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:55:15.540027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:15.541923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:15.549776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 603/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:15.555622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:15.650261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7bac-33ea-4fb9-951c-53171ccc284f None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:15.652494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:15.683148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:15.684016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.684297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.684566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] PATH_INFO: `/v3/users/60ffce8bef3d476bbffcd63b8d84145f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.685725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] RBAC: Authorizing `identity:get_user(user_id=60ffce8bef3d476bbffcd63b8d84145f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:15.687124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:15.688741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 594/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Jun 22 05:55:15 2022] GET /identity/v3/users/60ffce8bef3d476bbffcd63b8d84145f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:15.694437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:15.815961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dffa-1123-44dc-967e-8833db45eccc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:15.856014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:15.856953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:15.857231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:15.857506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:15.889629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:15.928989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:15.930371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:16.034855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 604/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:55:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:55:16.040777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:16.139145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eaf3d-ee3e-4b28-82d3-c2377a51cd2a None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:16.171166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:16.172018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:16.172296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:16.172563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] PATH_INFO: `/v3/projects/37f64c4f34ed4d748b613d78e703185e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:16.173709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] RBAC: Authorizing `identity:get_project(project_id=37f64c4f34ed4d748b613d78e703185e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:16.175116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15ad25-9d6c-40a7-b58c-e404e8772c11 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:16.176805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 595/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Jun 22 05:55:16 2022] GET /identity/v3/projects/37f64c4f34ed4d748b613d78e703185e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:16.185279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:55:16.246448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:16.281674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e7783-1f0d-4c09-a4df-e3e8c54d5d3e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:55:16.314704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:55:16.315334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:55:16.315638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:55:16.315910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:55:16.316723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=37f64c4f34ed4d748b613d78e703185e, user.id=60ffce8bef3d476bbffcd63b8d84145f) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:55:16.317028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:55:16.318446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f30570-3a64-4d59-a053-e9e709dfc901 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:55:16.324127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 605/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:55:16 2022] GET /identity/v3/role_assignments?user.id=60ffce8bef3d476bbffcd63b8d84145f&scope.project.id=37f64c4f34ed4d748b613d78e703185e&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:55:26.166652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=80 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:55:26.321433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=36 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:11.366844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58f29-a48c-44b7-917b-6edcbd60944a None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:11.367441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58f29-a48c-44b7-917b-6edcbd60944a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:11.367441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d58f29-a48c-44b7-917b-6edcbd60944a None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:11.369032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 596/1201] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:11.374556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:11.375159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:11.375159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:11.393549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:11.394791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:11.486517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 606/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:56:11.513897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58f29-a48c-44b7-917b-6edcbd60944a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:11.653723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d58f29-a48c-44b7-917b-6edcbd60944a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:11.720631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:11.721549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:11.721831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:11.722110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:11.734313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:11.736070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:11.765073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:11.768063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:11.769134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:11.769134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:11.769134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:11.769134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:11.769134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 597/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:11.775740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:11.916274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0facd-d0f2-4352-bd58-03c4be133a43 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:11.951931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:11.960354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:11.961161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:11.961488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:11.961772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:11.962507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:11.962813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:11.964307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0dfbe-4877-43b5-998e-4a6c6a0801fb None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:11.978260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 607/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:11.985020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:12.062422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:12.133882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbac7f-dee3-49a1-a340-5deef9a8fa52 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:12.190087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:12.190784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:12.191078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:12.191335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:12.192070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:12.193508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d38b84-b28e-41a2-998a-bf2927f33f93 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:12.230568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 598/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Jun 22 05:56:11 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:56:14.485742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661f55-04dc-422b-bc64-31f92144b3bf None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:14.486278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661f55-04dc-422b-bc64-31f92144b3bf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:14.486278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0661f55-04dc-422b-bc64-31f92144b3bf None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:14.487784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 608/1206] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:14.495769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:14.495769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:14.495769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:14.514489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:14.515989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:14.594678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 599/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:14.621885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0661f55-04dc-422b-bc64-31f92144b3bf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:14.745586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0661f55-04dc-422b-bc64-31f92144b3bf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:14.795315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:14.796151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:14.796406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:14.796701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:14.809102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:14.818761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:14.820024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:14.821137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 609/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:14.828561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:14.874695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:14.943951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8571c7-fac8-49c4-aa71-33d45d116a74 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:14.981899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:14.982693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:14.983545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:14.983545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:14.984307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:14.984696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:14.986160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:14.996261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 600/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:56:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:15.001784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:15.057278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:15.115960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4146bc2-9876-4a17-b4d7-362a23e80292 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:15.158158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:15.159108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:15.159417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:15.159695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:15.172651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:15.174221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:15.193314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:15.194510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:15.196605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:15.196605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:15.196605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:15.196605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:15.196605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 610/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:15.200574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:15.323163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:15.326278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc605a-4423-44f9-bde2-cc8b77a5c7cd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:15.367953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:15.368720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:15.369031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:15.369340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:15.370240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:15.370547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:15.372089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:15.385230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 601/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:15.391211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:15.506752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685371a4-a5f9-40cb-88e0-93199d40869f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:15.508863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:15.550788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:15.551636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:15.551922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:15.552196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:15.560238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:15.561772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:15.578231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:15.579284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:15.580279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 611/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:15.586030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:15.703632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ed90-e79b-419c-a6aa-59a5e7f54f16 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:15.746414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:15.747112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:15.747390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:15.747715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:15.748559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:15.748872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:15.750295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:15.770014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 602/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:15.776142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:15.907038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60128-8442-46f7-b3ef-23fe14613885 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:15.945484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:15.946262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:15.946546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:15.946927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:15.988814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:16.033596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:16.035201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:16.183177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:16.183759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 612/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:56:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:56:16.208244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:16.309738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060c10-3ed1-4e73-ab80-971ed543a8c8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:16.352679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:16.353714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:16.354162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:16.354577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:16.366843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:16.372454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:16.392761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:16.400393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:16.401564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:16.401564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:16.401564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:16.401564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:16.401564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 603/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:16.401929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:16.481354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:16.526198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a0f4b-d19c-4a01-bc37-0f685f8014bc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:16.562740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:16.563395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:16.563702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:16.563980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:16.564691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:16.564992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:16.566340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:16.578762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 613/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:16.584873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:16.665029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:16.706987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b87a2f-1b8d-47a4-8ca4-9e0c257fec63 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:16.752348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:16.753124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:16.753874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:16.754178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:16.764901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:16.766499 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:16.782994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:16.784294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:16.785465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 604/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:16.790462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:16.902483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387729-46d6-4301-a38d-72d43e85a732 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:16.927172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:16.939449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:16.940130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:16.940408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:16.940681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:16.941462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:16.941770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:16.943193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843148-e841-4468-ab71-b3619d5e2ae7 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:16.955935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 614/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:16.962086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:17.069854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ef18b-97bd-40d4-b1f9-6613da3ace07 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:17.103251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:17.111432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:17.112310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:17.112729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:17.113171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:17.114173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=90fb8c894b484ab1b739d5e8e6dec3b8) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:17.114677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:17.118274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b19853-07c2-49c8-ad0e-6b7067c59742 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:17.128982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 605/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:56:16 2022] GET /identity/v3/role_assignments?user.id=90fb8c894b484ab1b739d5e8e6dec3b8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:19.288117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33db335-ae27-4bd3-a766-e2125c3235f6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:19.288841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33db335-ae27-4bd3-a766-e2125c3235f6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:19.288841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33db335-ae27-4bd3-a766-e2125c3235f6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:19.290161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 615/1220] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:19.295562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:19.296008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:19.296119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:19.314477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:19.315714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:19.386547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 606/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:56:19.409694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33db335-ae27-4bd3-a766-e2125c3235f6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:19.520640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33db335-ae27-4bd3-a766-e2125c3235f6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:19.555442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:19.556266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:19.556549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:19.556825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:19.567767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:19.575952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:19.577137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:19.578111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 616/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:56:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:19.584460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:19.694326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895e7d-a152-45c3-8049-e6af05d6a2d5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:19.717888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:19.729311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:19.729963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:19.730242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:19.730522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:19.731292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:19.731622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:19.733044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:19.741666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 607/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:56:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:19.747457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:19.792731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:19.852945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d411-1de6-45d1-8a1a-c22e2b9f12ac None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:19.887854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:19.888678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:19.888962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:19.889236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:19.902028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:19.903798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:19.921666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:19.922781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:19.923981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:19.923981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:19.923981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:19.923981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:19.923981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 617/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:19.928775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.040188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8ab08-1152-4605-9b9a-5e8a27fc81e0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:20.084746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:20.085331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:20.085646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:20.086010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:20.086808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:20.087184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:20.088755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:20.102425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 608/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:20.108636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.210055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:20.219143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396d24-9a36-4b1b-bb5f-10cb2d07c57e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:20.256424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:20.256714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:20.256856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:20.257128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:20.264948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:20.266523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:20.282266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:20.283548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:20.284675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 618/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:20.289540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.338655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:20.401512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328fb4a-eeb0-4843-b5b7-1a5c194916b8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:20.438660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:20.439355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:20.439679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:20.439955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:20.440911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:20.441201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:20.442736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:20.462317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 609/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:20.468810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.586931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19d308-4774-4b0b-b959-aac78f358a05 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:20.624947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:20.625834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:20.626183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:20.626460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:20.638938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:20.640448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:20.658814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:20.659981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:20.661097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:20.661097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:20.661097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:20.661097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:20.661097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 619/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:20.666544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.778746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84053-a3b6-4e3e-898b-25e53f9c8a92 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:20.781192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:20.821614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:20.822342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:20.822626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:20.822931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:20.823692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:20.824001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:20.825398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:20.837091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 610/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:20.844442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:20.855591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:20.962825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171f75-8701-473a-adce-af38f35e70b8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:21.004651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:21.005445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:21.005729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:21.006004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:21.012735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:21.014231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:21.028844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:21.029939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:21.030867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 620/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:21.037525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:21.153453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47e5e-7fb3-4518-86dc-7de8a9bc6af2 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:21.192662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:21.193315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:21.193598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:21.193873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:21.194655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:21.194962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:21.196411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81fe6-4d19-48fd-a453-4626f43a3a5a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:21.209711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 611/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:21.215856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:21.281785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:21.323580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61112aa-bb85-4cf5-b7ef-4000773746f6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:21.362233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:21.363149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:21.363643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:21.363929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/90fb8c894b484ab1b739d5e8e6dec3b8/roles/4eafa9c8530e4641a4bba3130bd695ad` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:21.380795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=90fb8c894b484ab1b739d5e8e6dec3b8, role_id=4eafa9c8530e4641a4bba3130bd695ad)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:21.382539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3247ad4-5edf-4d5f-803f-647c25ee0106 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:21.398914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 621/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:56:21 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/90fb8c894b484ab1b739d5e8e6dec3b8/roles/4eafa9c8530e4641a4bba3130bd695ad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 05:56:23.671463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9570-dc7b-431e-b5d9-34d2f9018728 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:23.672063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9570-dc7b-431e-b5d9-34d2f9018728 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:23.672286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9570-dc7b-431e-b5d9-34d2f9018728 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:23.674260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 612/1233] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:23.679684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:23.680133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:23.680259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:23.698574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:23.699833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:23.783537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 622/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:23.804469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9570-dc7b-431e-b5d9-34d2f9018728 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:23.837083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:23.927145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9570-dc7b-431e-b5d9-34d2f9018728 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:23.969823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:23.970645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:23.970994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:23.971272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:23.983801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:23.993712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:23.994913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:23.995812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 613/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Jun 22 05:56:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:24.001446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:24.054710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:24.116144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4e085-1fd9-4eeb-a56e-7c1a8cb1a0c4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:24.154773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:24.155490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:24.155822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:24.156102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:24.156883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:24.157194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:24.158568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:24.167701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 623/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:24.173635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:24.268657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:24.288288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa387568-5e06-45d3-a2c5-63c3d539304b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:24.328666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:24.329508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:24.329843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:24.330126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:24.342245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:24.343803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:24.363325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:24.364406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:24.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:24.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:24.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:24.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:24.365555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 614/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:24.370629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:24.477834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dd161-f236-44f1-b736-2429262237c0 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:24.486939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:24.515524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:24.516202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:24.516532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:24.516816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:24.517614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:24.517969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:24.519435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:24.530989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 624/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:24.537506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:24.655471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014fe7e-dec0-4b3b-ac02-f8cedd7fc99d None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:24.693115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:24.693907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:24.694192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:24.694494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:24.697407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:24.702959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:24.704693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:24.719235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:24.720458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:24.721638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 615/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:24.727622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:24.842273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810291ca-51f6-49c2-b07a-58c82f9861dc None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:24.880422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:24.881210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:24.881593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:24.882023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:24.883197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:24.883717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:24.885904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:24.908644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 625/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:24.914792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:25.021684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17218-6462-4910-b8c8-2c0fb42d3a58 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:25.057126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:25.057891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:25.058206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:25.059120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:25.139275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:25.149201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:25.151092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:25.274490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 616/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:56:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 05:56:25.280877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:25.313650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:25.400401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a0940-7a8f-4b28-aebd-df8f74cb268f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:25.442891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:25.443692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:25.443972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:25.444241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:25.456200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:25.458038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:25.479021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:25.480288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:25.481294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:25.481294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:25.481294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:25.481294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:25.481294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 626/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:25.487152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:25.607371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:25.614932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61970f0-6ab4-4b35-9f11-d2e1e1442779 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:25.651154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:25.651904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:25.652268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:25.652630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:25.653556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:25.653904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:25.655306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:25.670051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 617/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:25.676850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:25.767775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:25.790578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86e1-429b-49d6-b597-8b8708f2d20d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:25.829929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:25.831331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:25.832211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:25.832582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:25.842113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:25.844716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:25.864234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:25.865424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:25.866543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 627/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:25.871722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:26.000420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec0df-c17d-4047-ad68-1750164bb797 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:26.036743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:26.037476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:26.037946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:26.038266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:26.041607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:26.042107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:26.043669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843b2ab-7a55-468a-b4a6-49950952aa42 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:26.057801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 618/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:26.064090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:26.190121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57a21-0c3f-4d54-80ae-fab7aafc9fe5 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:26.235999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:26.236722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:26.236954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:26.237194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:26.238027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] RBAC: Adding query filter params (role.id=4eafa9c8530e4641a4bba3130bd695ad, scope.project.id=e576abf81756447c87069069c29d7003, user.id=90fb8c894b484ab1b739d5e8e6dec3b8) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:26.238363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:26.239806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf055-b31d-4587-9e6d-b1655d7b13a4 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:26.245834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 628/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:56:26 2022] GET /identity/v3/role_assignments?user.id=90fb8c894b484ab1b739d5e8e6dec3b8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4eafa9c8530e4641a4bba3130bd695ad => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:28.580641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9b93-88fe-446c-a5d8-d8687f8b5d96 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:28.581143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9b93-88fe-446c-a5d8-d8687f8b5d96 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:28.581266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9b93-88fe-446c-a5d8-d8687f8b5d96 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:28.582907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 619/1247] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:28.588930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:28.589349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:28.589489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:28.595249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:28.609337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:28.610530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:28.690634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 629/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:28.714555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9b93-88fe-446c-a5d8-d8687f8b5d96 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:28.735324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:28.836748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9b93-88fe-446c-a5d8-d8687f8b5d96 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:28.881012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:28.881812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:28.882101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:28.882443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:28.896218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:28.905221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:28.906573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:28.907669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 620/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:28.914748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.029854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cbed5-e4bd-4483-bdbc-4f59153c8ec1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.062347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:29.069307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.070091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.070389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.070634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:29.071436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:29.071824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:29.073269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:29.085348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 630/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:29.091889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.188914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:29.219932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432061-535a-474a-a90a-c090269faca0 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.260779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.261689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.261973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.262268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:29.274371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:29.275974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:29.294775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:29.295843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:29.296745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:29.296745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:29.296745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:29.296745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:29.296745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 621/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 05:56:29.303429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.412747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25726b-b3ce-4a49-a148-2dc2476ee92a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.450010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.450758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.451072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.451400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:29.452304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:29.452667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:29.454169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:29.467987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 631/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:29.474271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.583157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d827a-9104-46e0-8e66-924d280eb97e None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.612589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:29.622178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.622990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.623267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.623563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:29.632800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:29.634423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:29.650275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:29.651469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:29.652719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 622/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:29.659455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.718996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:29.778782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a7a5d-5df7-418e-a7e2-4e079cb0477c None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.815836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.816534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.816815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.817121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:29.818107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:29.818415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:29.820142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:29.840676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 632/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:29.846753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:29.959426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db57e04-32fd-4298-8384-fbc692a3c5cd None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:29.998449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:29.999091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:29.999372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:29.999669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:30.057830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:30.074516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:30.076098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:30.184613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 623/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:56:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 05:56:30.190780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:30.297359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9c63-c294-4082-8300-3c85fe3e346a None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:30.310766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:30.333572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:30.334356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:30.334632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:30.334901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:30.345520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:30.346981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:30.366079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:30.367242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:30.368433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:30.368433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:30.368433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:30.368433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:30.372099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 633/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:30.373172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:30.472884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:30.486488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509eba-66c3-443e-87d1-cc058034c553 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:30.522099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:30.522757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:30.523042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:30.523322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:30.524075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:30.524384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:30.525749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:30.537036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 624/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:30.543637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:30.647194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69143a7-8c13-4373-a564-0a000ef44c6e None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:30.682746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:30.683551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:30.683845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:30.684128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:30.691292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:30.693297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:30.707315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:30.708860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:30.709776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 634/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:30.715813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:30.818523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f59be-7934-4d55-8a63-f565a61e5cf4 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:30.854504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:30.855280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:30.855639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:30.855948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:30.856835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:30.857207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:30.858716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248d6c-218f-4929-b290-9ff8e2145bf1 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:30.872635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 625/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:30.878790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:30.907703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:30.993938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677272dc-28d9-4e95-9263-caa83b65fe48 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:31.029022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:31.029680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:31.029964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:31.030237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:31.031074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=90fb8c894b484ab1b739d5e8e6dec3b8) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:31.031383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:31.032878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586af4-01e3-4eec-bbfd-e05e3e05269c None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:31.039149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 635/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:56:30 2022] GET /identity/v3/role_assignments?user.id=90fb8c894b484ab1b739d5e8e6dec3b8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:33.061123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ca23-2076-4135-9980-42dd5c98a39c None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.061668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ca23-2076-4135-9980-42dd5c98a39c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.061668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ca23-2076-4135-9980-42dd5c98a39c None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.063042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 626/1261] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:33.069138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.069610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.069805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.086736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:33.087941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:33.161903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 636/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:56:33.184886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ca23-2076-4135-9980-42dd5c98a39c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:33.196175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:33.282765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ca23-2076-4135-9980-42dd5c98a39c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:33.314806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:33.315518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.315807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.316078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.326213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:33.333960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:33.335044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:33.335946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 627/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:33.341148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:33.358525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:33.436799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570d533-9daf-4fb1-ab65-330949949cdd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:33.468562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:33.469210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.469490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.469765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.470502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:33.470808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:33.472193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:33.480380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 637/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:33.486180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:33.551333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:33.584391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4166-b6f3-46aa-8ad7-98da0eff8310 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:33.616518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:33.617274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.617550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.617819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.627888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:33.629307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:33.645756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:33.646678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:33.647723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:33.647723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:33.647723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:33.647723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:33.647723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 628/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:33.652702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:33.730110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:33.748884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5e83-ff1b-40f4-90c8-4f574db0e595 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:33.782657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:33.783307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.783618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.783900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.784616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:33.784925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:33.786828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:33.798053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 638/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:33.804494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:33.900819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d416-ebbe-4fd5-b789-5717b89f9760 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:33.919738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:33.933377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:33.934145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:33.934428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:33.934702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:33.941877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:33.943322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:33.957319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:33.958951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:33.960190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 629/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:33.964664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.059887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6130d3-87a4-4506-a91c-7f14db0a309f None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.097226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.098064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.098272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.099010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.099940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:34.100248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.101715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.110911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:34.119859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 639/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:34.125619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.224921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a62a21-9a46-4a25-bdc2-9eecfd349f72 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.257036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.257827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.258104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.258374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.268314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.269724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:34.286376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:34.287432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:34.288591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:34.288591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:34.288591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:34.288591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:34.288591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 630/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:34.293314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.389461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48e437-efde-40cb-ab7a-11e8bfa99010 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.422231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.422877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.423158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.423434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.424182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:34.424491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.425860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.436585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 640/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:34.442771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.473745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:34.539655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d4667-2a45-46d5-9395-0ba6c4ec824b None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.572011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.572775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.573059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.573325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.580569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.582339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:34.596544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:34.597628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:34.598618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 631/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:34.604185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.659352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:34.698988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f59-1026-4d8c-8d46-49224ebe88c6 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.731232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.731870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.732148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.732419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.733187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:34.733488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.734898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690ddd-932a-4124-b504-7c94b6f522b6 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.746154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 641/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:34.751872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:34.837590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:34.846306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713137ef-1559-410d-bf79-bc51337c48f5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:34.878468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:34.879318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:34.879648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:34.879923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] PATH_INFO: `/v3/projects/e576abf81756447c87069069c29d7003/users/90fb8c894b484ab1b739d5e8e6dec3b8/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:34.881808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e576abf81756447c87069069c29d7003, user_id=90fb8c894b484ab1b739d5e8e6dec3b8, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:34.883220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b877e-ea3b-424d-9c2c-0498e94774f5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:34.896638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 632/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Jun 22 05:56:34 2022] PUT /identity/v3/projects/e576abf81756447c87069069c29d7003/users/90fb8c894b484ab1b739d5e8e6dec3b8/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 05:56:36.902433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ebe3b-d778-44ba-813a-7bb137bc698a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:36.902954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ebe3b-d778-44ba-813a-7bb137bc698a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:36.903048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ebe3b-d778-44ba-813a-7bb137bc698a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:36.904373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 642/1274] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:36.909510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:36.909939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:36.910053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:36.926838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:36.928041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:36.992969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 633/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:37.016290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ebe3b-d778-44ba-813a-7bb137bc698a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.114304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ebe3b-d778-44ba-813a-7bb137bc698a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.131103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:37.147326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.148134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.148418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.148689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.158382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 05:56:37.166341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:37.167448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:37.172583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 643/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:37.173467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.254259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:37.272181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08970f-039a-4208-aa56-5e13fc3160fe None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.315324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.316009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.316296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.316574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.317347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:37.317654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:37.319019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:37.326892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 634/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:37.332833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.436175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d71-39ad-44a6-8357-d666fed0f320 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.471915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.472699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.473521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.476147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.484318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:37.485757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:37.505637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:37.506561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:37.507631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:37.507631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:37.507631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:37.507631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:37.507631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 644/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:37.512619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.618414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f75a-f754-4096-873f-cbbbb52bf3d3 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.652616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.653256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.653536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.653809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.654516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:37.654817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:37.656197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:37.668975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 635/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:37.674536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.705914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:37.778873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2104cd-c54d-4806-a91f-1d259ca60595 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.812956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.813737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.814013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.814284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.823197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:37.824682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 05:56:37.839923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:37.841071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:37.842125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 645/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:37.847560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:37.852177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:37.950125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989b7e-5fe3-4e01-8cf4-6b9da0e32c31 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:37.984601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:37.985175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:37.985452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:37.985828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:37.986545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:37.986848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:37.989394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.006465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 636/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Jun 22 05:56:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:38.013025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:38.107790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:38.117891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee25c-42d6-484b-8232-ce953bc1923d None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:38.151660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:38.152298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:38.152580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:38.152856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:38.217313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:38.218765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.303549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:38.313678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 646/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 05:56:38.319519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:38.378855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:38.416905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c855-4aeb-4dc4-bed3-15051928b179 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:38.450340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:38.451110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:38.451394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:38.451705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:38.461814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:38.463241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 05:56:38.480050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:38.481081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:38.482313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 05:56:38.482313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 05:56:38.482313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 05:56:38.482313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:38.482313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 637/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:38.486914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:38.581606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5185-04ce-4025-85b5-dfaa78822ac1 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:38.613359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:38.614532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:38.614817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:38.615094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:38.615836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:38.616142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:38.617488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.628171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 647/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:38.634179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:38.730672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e947-8215-461d-9327-fb1bceb86ac8 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:38.744617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:38.764041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:38.764807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:38.765086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:38.765356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:38.772039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:38.773460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 05:56:38.787225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:38.788318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: ERROR keystone.server.flask.application Jun 22 05:56:38.789454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 638/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:38.794313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:38.842740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:38.890759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca758-17aa-44ef-b16b-0ca380d343ac None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:38.922754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:38.923404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:38.923714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:38.923993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:38.924766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:38.925076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:38.927109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c4d1f-52ac-46e0-8067-cb0082721d24 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:38.938590 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 648/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:38.944472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:39.039729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c027fe-023a-4f21-a081-5cf8bf86e0f5 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:39.071770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:39.072393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:39.072677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:39.072955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:39.073768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] RBAC: Adding query filter params (role.id=4cd2e68829054accb9aea2630b1fafb0, scope.project.id=e576abf81756447c87069069c29d7003, user.id=90fb8c894b484ab1b739d5e8e6dec3b8) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:39.074079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:39.075483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2c891-ab7e-49af-a78b-c2b2af665f8a None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:39.081108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 639/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Jun 22 05:56:38 2022] GET /identity/v3/role_assignments?user.id=90fb8c894b484ab1b739d5e8e6dec3b8&scope.project.id=e576abf81756447c87069069c29d7003&role.id=4cd2e68829054accb9aea2630b1fafb0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:41.127314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ea21-42b3-48f3-8f3b-2d36e12ab05d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:41.127931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ea21-42b3-48f3-8f3b-2d36e12ab05d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:41.127931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ea21-42b3-48f3-8f3b-2d36e12ab05d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:41.129264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 649/1288] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:41.134233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:41.134661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:41.134788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:41.151097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:41.152294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:41.181306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:41.217171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 640/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:41.240155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ea21-42b3-48f3-8f3b-2d36e12ab05d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:41.339722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ea21-42b3-48f3-8f3b-2d36e12ab05d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:41.351311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:41.374264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:41.375038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:41.375317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:41.375622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:41.376263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:41.377682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:41.389050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:41.390104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:41.391324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 650/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:56:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:41.396681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:41.490901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f42c7-513b-4c96-89d8-e26ccb3cb6a3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:41.523564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:41.524207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:41.524489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:41.524767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:41.525460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:41.525766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:41.527118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8356-9838-4f5c-a310-5892aa53f4e2 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:41.531836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 641/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 22 05:56:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:41.538015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:41.635826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bcb7f-6a39-4e03-85aa-7ccfaf492120 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:41.668161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:41.668820 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:41.669103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:41.669380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] PATH_INFO: `/v3/services` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:41.670079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:41.670382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:41.671769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4ee32-3ae9-4431-8c6f-a81de27a64c0 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:41.676174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 651/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 22 05:56:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:43.671155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1609f7-4bad-488e-9969-a7f66f1a5bc8 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:43.671719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1609f7-4bad-488e-9969-a7f66f1a5bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:43.671719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1609f7-4bad-488e-9969-a7f66f1a5bc8 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:43.673104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 642/1293] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:43.678196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60413-a3fb-4a56-995a-d668d2a2eb0b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:43.678608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60413-a3fb-4a56-995a-d668d2a2eb0b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:43.678759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c60413-a3fb-4a56-995a-d668d2a2eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:43.695042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e7c60413-a3fb-4a56-995a-d668d2a2eb0b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:43.696252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e7c60413-a3fb-4a56-995a-d668d2a2eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:43.725350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:43.760453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 652/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:43.783191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1609f7-4bad-488e-9969-a7f66f1a5bc8 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:43.813428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:43.882277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1609f7-4bad-488e-9969-a7f66f1a5bc8 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:43.915372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:43.916111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:43.916393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:43.916665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:43.917374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:43.918724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474b1b-9d76-44aa-942b-13e7dbb2176e None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:43.930967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 643/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Jun 22 05:56:43 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:56:45.978863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402fac-3510-439b-b1e8-2d6cf6969d05 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:45.979410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402fac-3510-439b-b1e8-2d6cf6969d05 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:45.979542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402fac-3510-439b-b1e8-2d6cf6969d05 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:45.980853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 653/1296] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:45.985960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:45.986361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:45.986520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:46.002797 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:46.003987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:46.073586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 644/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 05:56:46.098080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402fac-3510-439b-b1e8-2d6cf6969d05 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:46.201500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402fac-3510-439b-b1e8-2d6cf6969d05 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:46.236149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:46.236877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:46.237159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:46.237430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:46.238106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:46.239467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:46.250991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:46.252251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:46.253139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 654/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:56:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:46.258721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:46.277007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:46.355420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40123f3-2c18-4dcf-8cd2-f57fa9495758 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:46.387351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:46.388013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:46.388291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:46.388561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:46.389250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:46.389549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:46.390879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:46.396384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 645/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 22 05:56:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:46.402041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:46.431644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:46.496578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbe0b-c253-4c00-8ce0-bb90ef0f6db8 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:46.528448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:46.529073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:46.529351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:46.529622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:46.530393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] RBAC: Adding query filter params (interface=public, service_id=5d38b986722c479891aa7e8de5dfc61b, region_id=RegionOne) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:46.530697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:46.532074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c8406-9010-4eb6-b1cb-41e56b06ac84 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:46.536875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 655/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Jun 22 05:56:46 2022] GET /identity/v3/endpoints?service_id=5d38b986722c479891aa7e8de5dfc61b&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 05:56:46.542237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:46.620074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:46.638510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf739-1d67-4223-acdf-fec8bea6eec6 None admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:46.670259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:46.670895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:46.671174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:46.671446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:46.672141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:46.673489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f1c54-142a-4986-89cd-0a4fd77c6ec3 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:46.680711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 646/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Jun 22 05:56:46 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 05:56:48.696900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3e2-d02e-4e41-8505-442975522a36 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:48.697441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3e2-d02e-4e41-8505-442975522a36 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:48.697545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc3e2-d02e-4e41-8505-442975522a36 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:48.698872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 656/1302] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:56:48.703941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:48.704334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:48.704506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:48.721550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:56:48.722733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:56:48.786378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 647/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:56:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 05:56:48.809317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc3e2-d02e-4e41-8505-442975522a36 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:48.900440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:48.907001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc3e2-d02e-4e41-8505-442975522a36 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:48.938652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:48.939423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:48.939728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:48.940006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:48.940652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:48.942566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 05:56:48.954124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 05:56:48.955285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application with Lock( Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self._enter() Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application return self.creator() Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application created_value = creator( Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: ERROR keystone.server.flask.application Jun 22 05:56:48.956767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 657/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Jun 22 05:56:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 05:56:48.961415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:49.034355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:49.056950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a93ee-dd75-4bbb-a434-d39a7b675304 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:49.092022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:49.092675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:49.092956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:49.093237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] PATH_INFO: `/v3/services` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:49.093943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 05:56:49.094275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:49.095693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b410534-d6db-476a-9dc7-47a046888848 None admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:49.100907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 648/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Jun 22 05:56:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 05:56:49.106942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:56:49.208142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2310a58-0e5f-4c94-8f8b-ae734d5d65d3 None admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:56:49.240770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:56:49.241415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:56:49.241695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:56:49.241966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:56:49.242705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:56:49.244127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c397-c555-4e6d-acd0-d8d636ee0847 None admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:56:49.261354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 658/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Jun 22 05:56:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 05:56:59.097893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=30 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:56:59.257462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:51.266620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8d1-d98f-4406-a05e-f304792ff012 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:51.267183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8d1-d98f-4406-a05e-f304792ff012 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:51.267183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741b8d1-d98f-4406-a05e-f304792ff012 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:51.268720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 649/1307] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:57:51.274008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78ca5-16ef-4040-91d6-a7d917cd947f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:51.274858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78ca5-16ef-4040-91d6-a7d917cd947f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:51.275448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78ca5-16ef-4040-91d6-a7d917cd947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:51.352182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b7e78ca5-16ef-4040-91d6-a7d917cd947f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:57:51.353737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b7e78ca5-16ef-4040-91d6-a7d917cd947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:51.547609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 659/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:57:51.596990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:51.597280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:51.597601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:51.598995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 650/1309] 10.222.0.13 () {54 vars in 964 bytes} [Wed Jun 22 05:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:57:51.605094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234cc7-4b92-40f4-aa73-9aec52c3ddc6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:51.605391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234cc7-4b92-40f4-aa73-9aec52c3ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:51.605675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234cc7-4b92-40f4-aa73-9aec52c3ddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:51.687208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-97234cc7-4b92-40f4-aa73-9aec52c3ddc6 None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:57:51.688461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-97234cc7-4b92-40f4-aa73-9aec52c3ddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:51.714874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:51.785063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 660/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Jun 22 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:57:51.794352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:57:51.796764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:51.918475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9305-d0d5-4769-9fd1-09457bc2d0d3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:57:51.997516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:57:51.998160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:51.998443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:51.998748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:52.000431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:52.056370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:52.118249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:57:52.119731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e09d-fa28-406c-a6da-a146bcd768d3 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:57:52.139167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 651/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 05:57:54.451305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:54.452375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:54.452475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:54.454174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 661/1312] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:57:54.459047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cfb5-940b-4372-a912-82370f9a957f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:54.459449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cfb5-940b-4372-a912-82370f9a957f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:54.459640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cfb5-940b-4372-a912-82370f9a957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:54.545176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-0da8cfb5-940b-4372-a912-82370f9a957f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:57:54.546334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0da8cfb5-940b-4372-a912-82370f9a957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:54.656200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 652/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:57:54.693025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:57:54.694642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:54.821095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcad931-3d4b-4112-96cb-6cbedf1e87c9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:57:54.903567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:54.906609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:57:54.907412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:54.907799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:54.908408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:54.910701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:55.025983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:57:55.027448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b4bd1-035c-4608-bc51-afbe0f13e308 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:57:55.046237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 662/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:57:57.398720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:57.399219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:57.399219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:57.400617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 653/1315] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:57:57.405625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbfb8-70bb-44c2-9c10-7cc2e9963ffa None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:57.406041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbfb8-70bb-44c2-9c10-7cc2e9963ffa None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:57.406175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbfb8-70bb-44c2-9c10-7cc2e9963ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:57.468260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e6afbfb8-70bb-44c2-9c10-7cc2e9963ffa None None] MFA Rules not processed for user `ba7ff7e4d70b4e069dca3cfaa238a67f`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:57:57.469428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e6afbfb8-70bb-44c2-9c10-7cc2e9963ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:57.519040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:57.562372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 663/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:57:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:57:57.602038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:57:57.603662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:57.613787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:57.707197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd27b0-72ce-4957-b5ea-aabc53cefd2b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:57:57.777163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:57:57.777791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:57:57.778073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:57:57.778344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:57:57.780328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:57:57.841227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:57:57.887483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:57:57.888959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc826d5-6660-46ef-ab26-596e11b17b03 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:57:57.906872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 654/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:57:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:00.459080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:00.459738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:00.459738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:00.461034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 664/1318] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:00.466262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c39a7-7f7d-4add-bda1-08b2137c46be None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:00.467267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c39a7-7f7d-4add-bda1-08b2137c46be None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:00.467362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c39a7-7f7d-4add-bda1-08b2137c46be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:00.528495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-737c39a7-7f7d-4add-bda1-08b2137c46be None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:00.530222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-737c39a7-7f7d-4add-bda1-08b2137c46be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:00.621488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 655/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:00.660137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:00.661832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:00.764178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f24d2-9224-4aac-a20f-a7af5411f436 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:00.834827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:00.835398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:00.835708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:00.835985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:00.837612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:00.845869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:00.943520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:00.944990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a0479-39e1-45f5-92cd-7d95442a9574 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:00.963027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 665/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 05:58:03.609188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:03.609713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:03.609795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:03.611256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 656/1321] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:03.616691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42ec6-d2d4-4909-8e13-2b366949e871 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:03.617141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42ec6-d2d4-4909-8e13-2b366949e871 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:03.617364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e42ec6-d2d4-4909-8e13-2b366949e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:03.681711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e5e42ec6-d2d4-4909-8e13-2b366949e871 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:03.682918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e5e42ec6-d2d4-4909-8e13-2b366949e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:03.742375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:03.787671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 666/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:03.824846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:03.826586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:03.847159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:03.936847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c5ef-7366-4e8c-8c25-6fa433be1ad5 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:04.012746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:04.013408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:04.013689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:04.013962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:04.015616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:04.089211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:04.127812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:04.129243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392e5db-4148-4eb2-99d9-fec9dff931f6 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:04.148347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 657/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:06.213903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:06.214418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:06.214418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:06.215933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 667/1324] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:06.221064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30f7dd-11dd-4e22-9917-ddb958f3ebc0 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:06.221479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30f7dd-11dd-4e22-9917-ddb958f3ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:06.221586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30f7dd-11dd-4e22-9917-ddb958f3ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:06.283692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4a30f7dd-11dd-4e22-9917-ddb958f3ebc0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:06.284888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4a30f7dd-11dd-4e22-9917-ddb958f3ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:06.378773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 658/1325] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:06.414138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:06.415723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:06.516587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804e00a-35f3-4f9d-8d1b-b8e10fdf6f20 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:06.588444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:06.589088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:06.589375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:06.589649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:06.591276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:06.608063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:06.708813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:06.710273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4797e-5ce9-4cf5-9f18-df171328c33f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:06.728565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 668/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:08.836942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:08.837521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:08.837521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:08.838882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 659/1327] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:08.844833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934697-d0bf-4102-95c6-4dec0842b22b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:08.845227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934697-d0bf-4102-95c6-4dec0842b22b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:08.845413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c934697-d0bf-4102-95c6-4dec0842b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:08.914815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4c934697-d0bf-4102-95c6-4dec0842b22b None None] MFA Rules not processed for user `ba7ff7e4d70b4e069dca3cfaa238a67f`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:08.916042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4c934697-d0bf-4102-95c6-4dec0842b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:08.981286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:09.014230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 669/1328] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:09.052260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:09.053887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:09.088224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:09.162195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe14d2-3c5f-4378-84ed-b55f1672adc0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:09.238110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:09.238759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:09.239041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:09.239320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:09.240999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:09.317726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:09.349935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:09.351363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89185516-18d1-49d7-9473-8841f3cc68ab service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:09.369436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 660/1329] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:11.637518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:11.638649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:11.638649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:11.640016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 670/1330] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:11.645237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3988-ead8-4788-9a37-b89602dacda7 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:11.645641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3988-ead8-4788-9a37-b89602dacda7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:11.645790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3988-ead8-4788-9a37-b89602dacda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:11.709111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-447f3988-ead8-4788-9a37-b89602dacda7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:11.710301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-447f3988-ead8-4788-9a37-b89602dacda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:11.802380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 661/1331] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:11.838310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:11.839870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:11.940108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799312-70bb-4e8c-8473-2471c867cd12 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:12.010711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:12.011343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:12.011662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:12.011943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:12.014075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:12.040207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:12.125427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:12.126877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f152762-e1bd-4a7a-914f-b8d4f8e7114e service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:12.144971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 671/1332] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:14.191363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b072a7-b38a-4cae-a44d-f9e8991e000b None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:14.192059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b072a7-b38a-4cae-a44d-f9e8991e000b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:14.192059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b072a7-b38a-4cae-a44d-f9e8991e000b None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:14.193337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 662/1333] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:14.198613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7b23-0836-42dd-a597-dc926d53d838 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:14.199016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7b23-0836-42dd-a597-dc926d53d838 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:14.199209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a7b23-0836-42dd-a597-dc926d53d838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:14.264696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ae6a7b23-0836-42dd-a597-dc926d53d838 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:14.265903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ae6a7b23-0836-42dd-a597-dc926d53d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:14.339495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:14.361858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 672/1334] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:14.417388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:14.417700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:14.417979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:14.419369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 663/1335] 10.222.0.13 () {54 vars in 964 bytes} [Wed Jun 22 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:14.425312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea14c-9a3f-4caf-aa89-ad31622c10e7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:14.425599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea14c-9a3f-4caf-aa89-ad31622c10e7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:14.425872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea14c-9a3f-4caf-aa89-ad31622c10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:14.499175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ac4ea14c-9a3f-4caf-aa89-ad31622c10e7 None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:14.500329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ac4ea14c-9a3f-4caf-aa89-ad31622c10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:14.578920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 673/1336] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Jun 22 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:14.588023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:14.589539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:14.628189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:14.691113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665ab27-8546-4f09-9c15-5930716c0ec1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:14.764349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:14.764902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:14.765180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:14.765450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:14.767063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:14.848387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:14.873223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:14.874646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a62a-c50f-4822-8c44-5d1946b7340c service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:14.892578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 664/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:17.720855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:17.721439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:17.721439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:17.722774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 674/1338] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:17.727899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d27ca-391a-4fac-89bd-4b2a843b7609 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:17.728296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d27ca-391a-4fac-89bd-4b2a843b7609 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:17.728457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d27ca-391a-4fac-89bd-4b2a843b7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:17.791563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-959d27ca-391a-4fac-89bd-4b2a843b7609 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:17.792803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-959d27ca-391a-4fac-89bd-4b2a843b7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:17.887968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 665/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:58:17.922998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:17.924535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:18.000535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:18.028324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c562ac-9ddb-480b-a8f0-e14f61b92a80 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:18.102039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:18.102829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:18.103144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:18.103462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:18.105478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:18.212220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:18.213657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4682aee-8a73-4f9c-8910-e6e0e801f8a8 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:18.231603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 675/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:22.265519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:22.266059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:22.266059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:22.267455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 666/1341] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:22.272652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b0cd-1f99-47e6-8ca9-7c5e4c86bf1a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:22.273099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b0cd-1f99-47e6-8ca9-7c5e4c86bf1a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:22.273235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b0cd-1f99-47e6-8ca9-7c5e4c86bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:22.279353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:22.343759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b2c3b0cd-1f99-47e6-8ca9-7c5e4c86bf1a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:22.344965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b2c3b0cd-1f99-47e6-8ca9-7c5e4c86bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:22.452935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 676/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:22.490749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:22.492879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:22.541930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:22.588233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd9968-e13a-4c02-8ec0-319842374e6e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:22.596503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:22.597159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:22.597449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:22.597757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:22.609258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:22.611943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f421-d9bb-4b19-80e6-63b4da58d28a service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:22.622162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 667/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:25.235516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b094b2-4898-40b8-9e1c-eeb08fffceef None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:25.235998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b094b2-4898-40b8-9e1c-eeb08fffceef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:25.236113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b094b2-4898-40b8-9e1c-eeb08fffceef None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:25.237473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 677/1344] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:25.242856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6fc9-690c-458b-aeb5-ca5b3fbd1d68 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:25.243390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6fc9-690c-458b-aeb5-ca5b3fbd1d68 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:25.243390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6fc9-690c-458b-aeb5-ca5b3fbd1d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:25.273884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-039b6fc9-690c-458b-aeb5-ca5b3fbd1d68 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:25.275456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-039b6fc9-690c-458b-aeb5-ca5b3fbd1d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:25.353500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 668/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:25.391794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b094b2-4898-40b8-9e1c-eeb08fffceef None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:25.403254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b094b2-4898-40b8-9e1c-eeb08fffceef None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:25.406786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:25.407435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:25.407742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:25.408014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:25.417825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:25.419326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1dc0b-432b-4d44-ae9d-da18948689f4 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:25.429977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 678/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:29.359884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec539b4-2238-4f9f-8f68-3888336bcb5d None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:29.360396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec539b4-2238-4f9f-8f68-3888336bcb5d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:29.360486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec539b4-2238-4f9f-8f68-3888336bcb5d None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:29.361885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 669/1347] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:29.367275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484beb70-615b-49e0-84b5-78979974bc88 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:29.367728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484beb70-615b-49e0-84b5-78979974bc88 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:29.368005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484beb70-615b-49e0-84b5-78979974bc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:29.385108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-484beb70-615b-49e0-84b5-78979974bc88 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:29.386375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-484beb70-615b-49e0-84b5-78979974bc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:29.394312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 679/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:29.432270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec539b4-2238-4f9f-8f68-3888336bcb5d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:29.442648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec539b4-2238-4f9f-8f68-3888336bcb5d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:29.446217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:29.446850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:29.447131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:29.447409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:29.456722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:29.458145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb9ab8-b933-4bc0-a24e-94d40af3ddb4 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:29.468061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 670/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:34.525501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a648-cced-47aa-bb08-6aa2b4d0a236 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:34.526468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a648-cced-47aa-bb08-6aa2b4d0a236 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:34.526948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a648-cced-47aa-bb08-6aa2b4d0a236 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:34.528981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 680/1350] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 05:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:34.534288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13ca1-cee6-4e41-a31e-d41209d9180f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:34.535080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13ca1-cee6-4e41-a31e-d41209d9180f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:34.535498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13ca1-cee6-4e41-a31e-d41209d9180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:34.621747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bdb13ca1-cee6-4e41-a31e-d41209d9180f None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:34.623293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bdb13ca1-cee6-4e41-a31e-d41209d9180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:34.655232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:34.733457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 671/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 05:58:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:38.980926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beb219-fd4d-4aeb-bc4e-80f5fcf572e0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:38.982003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beb219-fd4d-4aeb-bc4e-80f5fcf572e0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:38.982003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beb219-fd4d-4aeb-bc4e-80f5fcf572e0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:38.983694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 681/1352] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 05:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:38.989599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4f73-b728-4316-b188-cfcf76b76b72 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:38.990025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4f73-b728-4316-b188-cfcf76b76b72 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:38.990216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b4f73-b728-4316-b188-cfcf76b76b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:39.009086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e89b4f73-b728-4316-b188-cfcf76b76b72 None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:39.010297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e89b4f73-b728-4316-b188-cfcf76b76b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:39.018934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 672/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 05:58:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:39.381555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=72 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:40.509171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860b29-04ac-4000-93e7-ec71b84684bc None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:40.509762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860b29-04ac-4000-93e7-ec71b84684bc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:40.509762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860b29-04ac-4000-93e7-ec71b84684bc None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:40.511020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 682/1354] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 05:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:40.515947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fa33-30fd-4a64-83fb-e594d8ec88ba None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:40.516380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fa33-30fd-4a64-83fb-e594d8ec88ba None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:40.516510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226fa33-30fd-4a64-83fb-e594d8ec88ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:40.534365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4226fa33-30fd-4a64-83fb-e594d8ec88ba None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:40.535604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4226fa33-30fd-4a64-83fb-e594d8ec88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:40.545408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 673/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 05:58:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:58:44.140092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760c82-45d8-4d41-ab5e-6dc043cccdf3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:44.140672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760c82-45d8-4d41-ab5e-6dc043cccdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:44.140672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a760c82-45d8-4d41-ab5e-6dc043cccdf3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:44.142277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 683/1356] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:44.147490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63b694-26a4-4f9c-830f-efd71ea4becd None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:44.148371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63b694-26a4-4f9c-830f-efd71ea4becd None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:44.148875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63b694-26a4-4f9c-830f-efd71ea4becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:44.172008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3e63b694-26a4-4f9c-830f-efd71ea4becd None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:44.173213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3e63b694-26a4-4f9c-830f-efd71ea4becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:44.181447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 674/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:44.241176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc188-dd21-4833-a527-0a4540cf3540 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:44.242100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc188-dd21-4833-a527-0a4540cf3540 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:44.243144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfc188-dd21-4833-a527-0a4540cf3540 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:44.245935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 684/1358] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 22 05:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:44.256583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91aab4-1c7d-4ea1-91fb-d1cbef929e1e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:44.257151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91aab4-1c7d-4ea1-91fb-d1cbef929e1e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:44.257616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91aab4-1c7d-4ea1-91fb-d1cbef929e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:44.308903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-cf91aab4-1c7d-4ea1-91fb-d1cbef929e1e None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:44.310856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-cf91aab4-1c7d-4ea1-91fb-d1cbef929e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:44.401690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 675/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 22 05:58:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:44.409748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfc188-dd21-4833-a527-0a4540cf3540 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:44.425483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfc188-dd21-4833-a527-0a4540cf3540 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:44.430817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:44.431458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:44.431838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:44.432119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:44.441271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:44.442882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a40e57-ee2b-4e50-9dc0-26c9926bf8a2 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:44.452741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 685/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:46.694405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fafe2a-393d-472a-8716-5d74e06ae6d2 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:46.694942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fafe2a-393d-472a-8716-5d74e06ae6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:46.694942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fafe2a-393d-472a-8716-5d74e06ae6d2 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:46.696551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 676/1361] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:46.702077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125721-55f6-4eb9-93bd-2805c3733e63 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:46.702494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125721-55f6-4eb9-93bd-2805c3733e63 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:46.702626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125721-55f6-4eb9-93bd-2805c3733e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:46.720731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-28125721-55f6-4eb9-93bd-2805c3733e63 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:46.721937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-28125721-55f6-4eb9-93bd-2805c3733e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:46.729970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 686/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:46.774453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fafe2a-393d-472a-8716-5d74e06ae6d2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:46.789037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fafe2a-393d-472a-8716-5d74e06ae6d2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:46.794693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:46.795333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:46.795645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:46.795926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:46.804535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:46.806133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad4c5b-eb93-490d-8d11-c441ffd0b3ac service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:46.816888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 677/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 05:58:49.180068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031af71-690a-4796-bd17-ebd6870ccec9 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:49.180486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031af71-690a-4796-bd17-ebd6870ccec9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:49.180643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031af71-690a-4796-bd17-ebd6870ccec9 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:49.182233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 687/1364] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:49.193350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b862b-a279-4dac-b4aa-fa3b7c03cdfe None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:49.194267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b862b-a279-4dac-b4aa-fa3b7c03cdfe None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:49.194915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b862b-a279-4dac-b4aa-fa3b7c03cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:49.217800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a83b862b-a279-4dac-b4aa-fa3b7c03cdfe None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:49.219155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a83b862b-a279-4dac-b4aa-fa3b7c03cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:49.227318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 678/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:49.272849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1680-b9b5-4ac5-986c-a00d9a0b6bc3 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:49.273137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1680-b9b5-4ac5-986c-a00d9a0b6bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:49.273440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1680-b9b5-4ac5-986c-a00d9a0b6bc3 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:49.274832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 688/1366] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 22 05:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:49.280638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880e7-cd49-4bb8-b9de-cbca252d0fa9 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:49.280920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880e7-cd49-4bb8-b9de-cbca252d0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:49.281194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96880e7-cd49-4bb8-b9de-cbca252d0fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:49.298914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e96880e7-cd49-4bb8-b9de-cbca252d0fa9 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:49.300135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e96880e7-cd49-4bb8-b9de-cbca252d0fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:49.309262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 679/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 22 05:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:49.316773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1680-b9b5-4ac5-986c-a00d9a0b6bc3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:49.331327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1680-b9b5-4ac5-986c-a00d9a0b6bc3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:49.336641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:49.337255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:49.337534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:49.337807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:49.347035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:49.349071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bf39b-aa11-4c90-a8e3-6a7cde7e9835 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:49.358460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 689/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:51.456495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ae89-5ddb-42ef-9cee-075d5e0905cb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:51.457088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ae89-5ddb-42ef-9cee-075d5e0905cb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:51.457308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9ae89-5ddb-42ef-9cee-075d5e0905cb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:51.458908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 680/1369] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:51.464419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb02ad-5a19-45d3-926c-ad92d516df55 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:51.464938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb02ad-5a19-45d3-926c-ad92d516df55 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:51.465029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb02ad-5a19-45d3-926c-ad92d516df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:51.484505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d0cb02ad-5a19-45d3-926c-ad92d516df55 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:51.485730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d0cb02ad-5a19-45d3-926c-ad92d516df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:51.494067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 690/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:51.538201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ae89-5ddb-42ef-9cee-075d5e0905cb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:51.553894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9ae89-5ddb-42ef-9cee-075d5e0905cb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:51.559975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:51.560744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:51.561118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:51.561685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:51.571097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:51.572820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ef94e-b5f6-47e3-9958-c95439063031 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:51.583608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 681/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:52.232928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377640-c1fd-4652-aa9d-df73e34a2eee None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:52.233221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377640-c1fd-4652-aa9d-df73e34a2eee None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:52.233502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377640-c1fd-4652-aa9d-df73e34a2eee None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:52.235093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 691/1372] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:52.240452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f0f-094c-47e6-8ef2-fe4543e5e911 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:52.240870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f0f-094c-47e6-8ef2-fe4543e5e911 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:52.241252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4f0f-094c-47e6-8ef2-fe4543e5e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:52.260529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-935f4f0f-094c-47e6-8ef2-fe4543e5e911 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:52.261737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-935f4f0f-094c-47e6-8ef2-fe4543e5e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:52.270176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 682/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:58:52.585012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e54cd-a936-45d5-bda4-de298f7d09fb None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:52.585491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e54cd-a936-45d5-bda4-de298f7d09fb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:52.585577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e54cd-a936-45d5-bda4-de298f7d09fb None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:52.587210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 692/1374] 10.222.0.13 () {54 vars in 963 bytes} [Wed Jun 22 05:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:52.592737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8672fb-137e-41ed-a25e-b47be8ba14be None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:52.593179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8672fb-137e-41ed-a25e-b47be8ba14be None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:52.593490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8672fb-137e-41ed-a25e-b47be8ba14be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:52.600256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:58:52.646523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fd8672fb-137e-41ed-a25e-b47be8ba14be None None] MFA Rules not processed for user `47e0e69820cb4c269c1d6043d70380f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:52.647904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fd8672fb-137e-41ed-a25e-b47be8ba14be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:52.711240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 683/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Jun 22 05:58:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:52.719365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e54cd-a936-45d5-bda4-de298f7d09fb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:52.730743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e54cd-a936-45d5-bda4-de298f7d09fb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:52.735209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:52.736076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:52.736469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:52.736849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:52.746941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:52.748597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b9d7-88b5-4dfb-81b5-704e12dd88be service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:52.758603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 693/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:53.690945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a14a-ac2f-4878-93e6-71014ceda915 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:53.691523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a14a-ac2f-4878-93e6-71014ceda915 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:53.691523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a14a-ac2f-4878-93e6-71014ceda915 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:53.692919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 684/1377] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:58:53.698244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e49a-f7a7-4b4b-a465-b17756aa8c49 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:53.698656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e49a-f7a7-4b4b-a465-b17756aa8c49 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:53.698816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e49a-f7a7-4b4b-a465-b17756aa8c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:53.718475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e855e49a-f7a7-4b4b-a465-b17756aa8c49 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:53.719763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e855e49a-f7a7-4b4b-a465-b17756aa8c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:53.727517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 694/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:53.776679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a14a-ac2f-4878-93e6-71014ceda915 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:53.792666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a14a-ac2f-4878-93e6-71014ceda915 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:53.798190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:53.798817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:53.799099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:53.799374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:53.807601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:53.809172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e5d7a-5d5b-4acd-91ad-ccb6a0390a45 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:53.818497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 685/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:55.886318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdc29-bb8f-4510-b319-b2d353208938 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:55.886852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdc29-bb8f-4510-b319-b2d353208938 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:55.886852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cdc29-bb8f-4510-b319-b2d353208938 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:55.888380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 695/1380] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:55.893605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2192b-c569-40bf-9081-35b00e505f12 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:55.894013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2192b-c569-40bf-9081-35b00e505f12 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:55.894171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2192b-c569-40bf-9081-35b00e505f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:55.912770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-65d2192b-c569-40bf-9081-35b00e505f12 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:55.914129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-65d2192b-c569-40bf-9081-35b00e505f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:55.923282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 686/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:55.968724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cdc29-bb8f-4510-b319-b2d353208938 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:55.982986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cdc29-bb8f-4510-b319-b2d353208938 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:55.988333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:55.988962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:55.989242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:55.989518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:55.997567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:55.999260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056e0de-4335-4037-b54f-b313191253d6 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:56.008537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 696/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:58:58.080569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f186-c903-4956-84d3-24793f0caa86 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:58.081090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f186-c903-4956-84d3-24793f0caa86 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:58.081173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f186-c903-4956-84d3-24793f0caa86 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:58.082757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 687/1383] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:58:58.088624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202bb6-4f2b-4fc9-a44e-29aeb6db719d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:58.089105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202bb6-4f2b-4fc9-a44e-29aeb6db719d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:58.089190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202bb6-4f2b-4fc9-a44e-29aeb6db719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:58.110195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ce202bb6-4f2b-4fc9-a44e-29aeb6db719d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:58:58.111378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ce202bb6-4f2b-4fc9-a44e-29aeb6db719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:58:58.120199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 697/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:58:58.162176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610f186-c903-4956-84d3-24793f0caa86 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:58:58.177474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610f186-c903-4956-84d3-24793f0caa86 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:58:58.182940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:58:58.183685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:58:58.184059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:58:58.184405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:58:58.193936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:58:58.195466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117aa95-e948-4ac4-91e5-7848f1fbdfd3 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:58:58.206352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 688/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:00.264068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d827-3a45-4228-a8a9-88f56ab79018 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:00.264576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d827-3a45-4228-a8a9-88f56ab79018 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:00.264576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3d827-3a45-4228-a8a9-88f56ab79018 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:00.265921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 698/1386] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:00.271195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288138c-3434-473c-9efa-21009378bca5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:00.271650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288138c-3434-473c-9efa-21009378bca5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:00.271796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288138c-3434-473c-9efa-21009378bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:00.290355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4288138c-3434-473c-9efa-21009378bca5 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:00.291817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4288138c-3434-473c-9efa-21009378bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:00.300579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 689/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:00.345654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d827-3a45-4228-a8a9-88f56ab79018 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:00.360545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3d827-3a45-4228-a8a9-88f56ab79018 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:00.365976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:00.366622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:00.366909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:00.367189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:00.376603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:00.378235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bcd4d-8afa-44a3-a510-48f87265c94d service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:00.387807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 699/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:02.490492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035f5c-aa6c-4d72-a1a6-d6da77e66ecb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:02.491154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035f5c-aa6c-4d72-a1a6-d6da77e66ecb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:02.491154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035f5c-aa6c-4d72-a1a6-d6da77e66ecb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:02.492360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 690/1389] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:02.498437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209e11-e83d-43e7-a0c6-8bc09239e9a0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:02.498891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209e11-e83d-43e7-a0c6-8bc09239e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:02.499318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf209e11-e83d-43e7-a0c6-8bc09239e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:02.522177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bf209e11-e83d-43e7-a0c6-8bc09239e9a0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:02.523795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bf209e11-e83d-43e7-a0c6-8bc09239e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:02.533937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 700/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:02.589568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035f5c-aa6c-4d72-a1a6-d6da77e66ecb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:02.607807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035f5c-aa6c-4d72-a1a6-d6da77e66ecb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:02.614818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:02.615623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:02.616255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:02.616614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:02.627801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:02.629892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1cb20-b4e7-40d0-a17c-d38a77b33750 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:02.643191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 691/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:04.714934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ba0-f5ea-439d-aeb1-11f80b131889 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:04.715467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ba0-f5ea-439d-aeb1-11f80b131889 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:04.715612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ba0-f5ea-439d-aeb1-11f80b131889 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:04.717570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 701/1392] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:04.722949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b7c2-b04a-4b64-bf4a-596f0d3f6c2c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:04.723418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b7c2-b04a-4b64-bf4a-596f0d3f6c2c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:04.723543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38b7c2-b04a-4b64-bf4a-596f0d3f6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:04.745922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fa38b7c2-b04a-4b64-bf4a-596f0d3f6c2c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:04.747123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fa38b7c2-b04a-4b64-bf4a-596f0d3f6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:04.754914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 692/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:04.799010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7ba0-f5ea-439d-aeb1-11f80b131889 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:04.813173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7ba0-f5ea-439d-aeb1-11f80b131889 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:04.818571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:04.819223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:04.819515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:04.819798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:04.829001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:04.831353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd10d2-adb2-46b1-84d7-095dfb05386c service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:04.848581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 702/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:06.902680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b34-907d-4f76-9704-81c424f21ff4 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:06.903282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b34-907d-4f76-9704-81c424f21ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:06.903282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51b34-907d-4f76-9704-81c424f21ff4 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:06.905195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 693/1395] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:06.910340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28286-bd69-4d3d-abb9-31789692653b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:06.910765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28286-bd69-4d3d-abb9-31789692653b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:06.910929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28286-bd69-4d3d-abb9-31789692653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:06.929689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9ba28286-bd69-4d3d-abb9-31789692653b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:06.930881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9ba28286-bd69-4d3d-abb9-31789692653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:06.939037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 703/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:06.983938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51b34-907d-4f76-9704-81c424f21ff4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:06.998179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51b34-907d-4f76-9704-81c424f21ff4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:07.003589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:07.004220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:07.004506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:07.004791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:07.012954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:07.014536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c1fb5-fc86-4d13-920b-e195001d2cc8 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:07.023924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 694/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:07.896569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6e3f-9fbe-4143-9397-7a2e60f3cea1 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:07.896872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6e3f-9fbe-4143-9397-7a2e60f3cea1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:07.897148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6e3f-9fbe-4143-9397-7a2e60f3cea1 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:07.898602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 704/1398] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:07.903847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891f15-ef85-41e3-99b9-98d2c78a1589 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:07.904311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891f15-ef85-41e3-99b9-98d2c78a1589 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:07.905000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891f15-ef85-41e3-99b9-98d2c78a1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:07.923487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-88891f15-ef85-41e3-99b9-98d2c78a1589 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:07.924681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-88891f15-ef85-41e3-99b9-98d2c78a1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:07.932276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 695/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:07.987360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f090-4a5c-4458-96bd-0412dc362f0a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:07.987790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f090-4a5c-4458-96bd-0412dc362f0a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:07.987983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f090-4a5c-4458-96bd-0412dc362f0a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:07.989346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 705/1400] 10.222.0.13 () {54 vars in 962 bytes} [Wed Jun 22 05:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:07.999044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5e20-25e1-4337-afd1-6c8f34d0bfdf None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:07.999328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5e20-25e1-4337-afd1-6c8f34d0bfdf None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:07.999640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5e20-25e1-4337-afd1-6c8f34d0bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:08.046926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-688b5e20-25e1-4337-afd1-6c8f34d0bfdf None None] MFA Rules not processed for user `3c6d629e689d45d4b28b24b7f3d0d3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:08.048136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-688b5e20-25e1-4337-afd1-6c8f34d0bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:08.081160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:59:08.110264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 696/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Jun 22 05:59:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:08.117860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f090-4a5c-4458-96bd-0412dc362f0a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:08.128490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f090-4a5c-4458-96bd-0412dc362f0a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:08.131975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:08.132708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:08.132887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:08.133162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:08.142776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:08.144256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d4bce-0795-421d-8805-6907c8debdb1 service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:08.154506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 706/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:08.857538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c6506-7f88-4a2e-b1a7-c5eac91a24c5 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:08.857902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c6506-7f88-4a2e-b1a7-c5eac91a24c5 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:08.858245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c6506-7f88-4a2e-b1a7-c5eac91a24c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:08.906251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-391c6506-7f88-4a2e-b1a7-c5eac91a24c5 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:08.907435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-391c6506-7f88-4a2e-b1a7-c5eac91a24c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:08.972317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 697/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 05:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:09.012719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4341-4628-4b45-a256-baabc802a9f8 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.013190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4341-4628-4b45-a256-baabc802a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.013310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4341-4628-4b45-a256-baabc802a9f8 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.015180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 707/1404] 10.222.0.13 () {54 vars in 942 bytes} [Wed Jun 22 05:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:09.021353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.021647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.021928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.069894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] MFA Rules not processed for user `4d8b3103a87541c7ae82ca280985f174`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:09.071018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:09.101578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c936f6-3d38-41a2-8b4c-e3eacfc0b809 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.101868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c936f6-3d38-41a2-8b4c-e3eacfc0b809 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.102150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c936f6-3d38-41a2-8b4c-e3eacfc0b809 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.103619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 708/1405] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 05:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 05:59:09.109571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.109859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.110410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.127473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:09.128677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:09.136501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 709/1406] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 05:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:59:09.145039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 698/1407] 10.222.0.13 () {58 vars in 1039 bytes} [Wed Jun 22 05:59:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:59:09.156023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:09.167735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931aa65-f59d-4bb6-8ed5-6eac77aa759b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:09.173652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:09.174298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.174586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.174958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.181790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:09.184730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:09.186426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865ab9-de7b-4dc5-815f-57065edf0765 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:09.193507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1376dd-f23b-406c-97f2-101cfb85203a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:09.194484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 710/1408] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 05:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 05:59:09.199580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:09.200156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:09.200547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:09.200698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:09.210049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:09.214375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17006e-e6e3-4073-a4d9-1db56b803e66 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:09.220433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:59:09.227186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 699/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:19.191307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=69 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 05:59:31.507850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273013ae-45d1-4eff-b75b-daebeb72804d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:31.508470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273013ae-45d1-4eff-b75b-daebeb72804d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:31.508470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273013ae-45d1-4eff-b75b-daebeb72804d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:31.509691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 711/1410] 10.222.0.13 () {54 vars in 918 bytes} [Wed Jun 22 05:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:31.514796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adae25-87cf-4278-8dbf-88a28c2d2745 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:31.515230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adae25-87cf-4278-8dbf-88a28c2d2745 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:31.515362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adae25-87cf-4278-8dbf-88a28c2d2745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:31.533031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d0adae25-87cf-4278-8dbf-88a28c2d2745 None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:31.534221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d0adae25-87cf-4278-8dbf-88a28c2d2745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:31.542677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 700/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jun 22 05:59:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:31.556975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de53f-6c78-47f1-bc1c-e94a742dc61e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:31.557266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de53f-6c78-47f1-bc1c-e94a742dc61e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:31.557550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de53f-6c78-47f1-bc1c-e94a742dc61e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:31.558888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 712/1412] 10.222.0.13 () {54 vars in 918 bytes} [Wed Jun 22 05:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:31.563955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8ac-f061-4da4-b358-097b8744318d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:31.564245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8ac-f061-4da4-b358-097b8744318d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:31.564524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bc8ac-f061-4da4-b358-097b8744318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:31.590032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9c7bc8ac-f061-4da4-b358-097b8744318d None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:31.591239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9c7bc8ac-f061-4da4-b358-097b8744318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:31.600961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 701/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jun 22 05:59:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:34.083568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd344b-d1e1-4119-99f0-e333d9b8923f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:34.084093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd344b-d1e1-4119-99f0-e333d9b8923f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:34.084201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd344b-d1e1-4119-99f0-e333d9b8923f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:34.085484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:34.090596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9636e-0e17-4a8e-a0dd-422acf6e81f8 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:34.091039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9636e-0e17-4a8e-a0dd-422acf6e81f8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:34.091143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9636e-0e17-4a8e-a0dd-422acf6e81f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:34.109310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-54d9636e-0e17-4a8e-a0dd-422acf6e81f8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:34.110491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-54d9636e-0e17-4a8e-a0dd-422acf6e81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:34.118191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:34.160823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd344b-d1e1-4119-99f0-e333d9b8923f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:34.175639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd344b-d1e1-4119-99f0-e333d9b8923f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:34.181027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:34.181656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:34.181938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:34.182220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:34.190850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:34.192458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5967148-5de5-41f7-bf7d-d0b097726674 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:34.201826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 714/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:35.096587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64c0e-6583-429c-b0af-318cfdc40991 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:35.097148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64c0e-6583-429c-b0af-318cfdc40991 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:35.097148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64c0e-6583-429c-b0af-318cfdc40991 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:35.098518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:35.103646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8ccc-78ad-43e2-a049-afdb86ba589e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:35.104052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8ccc-78ad-43e2-a049-afdb86ba589e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:35.104216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8ccc-78ad-43e2-a049-afdb86ba589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:35.121842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-814a8ccc-78ad-43e2-a049-afdb86ba589e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:35.123032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-814a8ccc-78ad-43e2-a049-afdb86ba589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:35.130921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:35.281559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64c0e-6583-429c-b0af-318cfdc40991 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:35.295702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64c0e-6583-429c-b0af-318cfdc40991 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:35.301731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:35.302355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:35.302654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:35.302931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:35.310975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:35.313167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e282120-4b6a-42c2-8338-ee51ff49fbbe service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:35.322303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 704/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:36.203082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f6f6-bc3e-4a90-a2df-7c4d1b57f8a4 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:36.203612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f6f6-bc3e-4a90-a2df-7c4d1b57f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:36.203612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f6f6-bc3e-4a90-a2df-7c4d1b57f8a4 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:36.204990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:36.210223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0cae-e9f0-41b2-9ec9-127405b7686c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:36.210684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0cae-e9f0-41b2-9ec9-127405b7686c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:36.210792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0cae-e9f0-41b2-9ec9-127405b7686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:36.228298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-10bf0cae-e9f0-41b2-9ec9-127405b7686c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:36.229506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-10bf0cae-e9f0-41b2-9ec9-127405b7686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:36.237138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:36.386207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f6f6-bc3e-4a90-a2df-7c4d1b57f8a4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:36.401054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f6f6-bc3e-4a90-a2df-7c4d1b57f8a4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:36.406389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:36.407017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:36.407301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:36.407631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:36.415786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:36.417381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3e798-358e-4f0c-b2b1-aa77696e5f9b service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:36.427401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 717/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:37.285895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887f8c-ac57-4087-8e54-16455cf255ff None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:37.286395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887f8c-ac57-4087-8e54-16455cf255ff None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:37.286519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887f8c-ac57-4087-8e54-16455cf255ff None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:37.287893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:37.292617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718fb7-71e5-492f-a7c4-5f0665f1b420 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:37.293023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718fb7-71e5-492f-a7c4-5f0665f1b420 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:37.293181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718fb7-71e5-492f-a7c4-5f0665f1b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:37.310731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ad718fb7-71e5-492f-a7c4-5f0665f1b420 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:37.311959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ad718fb7-71e5-492f-a7c4-5f0665f1b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:37.319578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:37.468977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf887f8c-ac57-4087-8e54-16455cf255ff None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:37.482712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf887f8c-ac57-4087-8e54-16455cf255ff None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:37.488015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:37.488633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:37.488912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:37.489185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:37.497028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:37.498619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa628f6-acf9-449a-8a67-7d9ea705120c service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:37.507735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 707/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:38.368624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384609b9-f078-4a4f-899d-79f1640efc83 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:38.369182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384609b9-f078-4a4f-899d-79f1640efc83 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:38.369298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384609b9-f078-4a4f-899d-79f1640efc83 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:38.370608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:38.375628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2e50-8ee0-4b94-b103-89dbb066db75 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:38.376022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2e50-8ee0-4b94-b103-89dbb066db75 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:38.376187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2e50-8ee0-4b94-b103-89dbb066db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:38.393560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2bcb2e50-8ee0-4b94-b103-89dbb066db75 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:38.394741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2bcb2e50-8ee0-4b94-b103-89dbb066db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:38.402674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:38.553232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384609b9-f078-4a4f-899d-79f1640efc83 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:38.567684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384609b9-f078-4a4f-899d-79f1640efc83 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:38.573211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:38.573837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:38.574120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:38.574395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:38.583207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:38.584868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40be05-16d2-47d8-8d5d-42a38f560bfb service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:38.594380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 720/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:39.396823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796494-21a1-49b7-80b4-bad65e6a7080 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:39.397386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796494-21a1-49b7-80b4-bad65e6a7080 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:39.397386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c796494-21a1-49b7-80b4-bad65e6a7080 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:39.398815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:39.406003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c395-3994-457c-8a08-7b5da1ada764 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:39.406458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c395-3994-457c-8a08-7b5da1ada764 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:39.406648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c395-3994-457c-8a08-7b5da1ada764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:39.426500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0421c395-3994-457c-8a08-7b5da1ada764 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:39.428250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0421c395-3994-457c-8a08-7b5da1ada764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:39.437334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:59:39.596275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796494-21a1-49b7-80b4-bad65e6a7080 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:39.611192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c796494-21a1-49b7-80b4-bad65e6a7080 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:39.616718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:39.618180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:39.618463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:39.618737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:39.631354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:39.633080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a878-1a31-4ea1-9de2-5e72144a95e8 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:39.643447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 710/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:40.456012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af692-97d6-4193-a38e-2367038b6c19 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:40.456573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af692-97d6-4193-a38e-2367038b6c19 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:40.456573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af692-97d6-4193-a38e-2367038b6c19 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:40.458217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:40.463267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7475-3cc3-47f7-8256-12af356e048f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:40.463694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7475-3cc3-47f7-8256-12af356e048f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:40.463861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7475-3cc3-47f7-8256-12af356e048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:40.482151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-505e7475-3cc3-47f7-8256-12af356e048f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:40.483269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-505e7475-3cc3-47f7-8256-12af356e048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:40.490990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:40.639651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af692-97d6-4193-a38e-2367038b6c19 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:40.654287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af692-97d6-4193-a38e-2367038b6c19 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:40.659561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:40.660189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:40.660471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:40.660745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:40.668609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:40.670175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce440f-79c6-409a-adf3-ba912ea8632e service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:40.679332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 723/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:41.491778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3445-87a2-417c-aa18-8a8b33e16c02 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:41.492306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3445-87a2-417c-aa18-8a8b33e16c02 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:41.492306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3445-87a2-417c-aa18-8a8b33e16c02 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:41.493650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:41.498497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bbe79-b478-4cfe-a378-48ea1abfe141 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:41.498899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bbe79-b478-4cfe-a378-48ea1abfe141 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:41.499072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bbe79-b478-4cfe-a378-48ea1abfe141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:41.516411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-907bbe79-b478-4cfe-a378-48ea1abfe141 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:41.517578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-907bbe79-b478-4cfe-a378-48ea1abfe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:41.525273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:41.674004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3445-87a2-417c-aa18-8a8b33e16c02 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:41.687991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3445-87a2-417c-aa18-8a8b33e16c02 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:41.693139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:41.693756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:41.694033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:41.694308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:41.702121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:41.704204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a52829-9e5d-4d50-8b05-44861b954ba3 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:41.713693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 713/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:42.514737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4ca0-77a7-47ff-93aa-bae4f03ca640 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:42.515248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4ca0-77a7-47ff-93aa-bae4f03ca640 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:42.515345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4ca0-77a7-47ff-93aa-bae4f03ca640 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:42.516687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 05:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:42.521591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbdf1-fbc8-4f64-b2cb-3de30bd022e4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:42.521998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbdf1-fbc8-4f64-b2cb-3de30bd022e4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:42.522157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acbdf1-fbc8-4f64-b2cb-3de30bd022e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:42.539594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-84acbdf1-fbc8-4f64-b2cb-3de30bd022e4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:42.540787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-84acbdf1-fbc8-4f64-b2cb-3de30bd022e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:42.548990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:42.697913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4ca0-77a7-47ff-93aa-bae4f03ca640 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:42.712211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4ca0-77a7-47ff-93aa-bae4f03ca640 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:42.717396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f816c7-071d-40af-83c0-be920263080a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:42.718073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f816c7-071d-40af-83c0-be920263080a service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:42.718352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f816c7-071d-40af-83c0-be920263080a service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:42.718626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f816c7-071d-40af-83c0-be920263080a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:42.726559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f816c7-071d-40af-83c0-be920263080a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:42.728192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f816c7-071d-40af-83c0-be920263080a service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:42.738309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 726/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:44.660751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971768f-d55f-4a50-bd38-122ae790c02b None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:44.661359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971768f-d55f-4a50-bd38-122ae790c02b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:44.661359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971768f-d55f-4a50-bd38-122ae790c02b None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:44.662675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:44.667829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59822a9-88f9-4a44-a05b-f00bc92a4e2f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:44.668234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59822a9-88f9-4a44-a05b-f00bc92a4e2f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:44.668425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59822a9-88f9-4a44-a05b-f00bc92a4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:44.686133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b59822a9-88f9-4a44-a05b-f00bc92a4e2f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:44.687319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b59822a9-88f9-4a44-a05b-f00bc92a4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:44.695035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:59:44.733314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971768f-d55f-4a50-bd38-122ae790c02b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:44.743836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971768f-d55f-4a50-bd38-122ae790c02b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:44.747327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:44.747988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:44.748274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:44.748552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:44.757294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:44.758705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3fae-71f0-4f6a-b27c-1fdface4dd65 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:44.768497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 716/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:47.014244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ad46-63fc-4857-a8b3-06f88b9eee8c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:47.015310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ad46-63fc-4857-a8b3-06f88b9eee8c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:47.015310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028ad46-63fc-4857-a8b3-06f88b9eee8c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:47.016748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:47.022081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4e40-d066-4f68-bdff-04c171e94341 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:47.022513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4e40-d066-4f68-bdff-04c171e94341 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:47.022625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa4e40-d066-4f68-bdff-04c171e94341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:47.041403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c6fa4e40-d066-4f68-bdff-04c171e94341 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:47.042600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c6fa4e40-d066-4f68-bdff-04c171e94341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:47.050653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 05:59:47.088550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ad46-63fc-4857-a8b3-06f88b9eee8c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:47.099690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028ad46-63fc-4857-a8b3-06f88b9eee8c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:47.103137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:47.103790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:47.104072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:47.104349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:47.113012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:47.114431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34dc4e-3f85-4a1e-aa71-4dbe75722536 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:47.123706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 729/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:49.456150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf21a-177f-41a6-87a3-7ba64d9e6a0d None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:49.456670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf21a-177f-41a6-87a3-7ba64d9e6a0d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:49.456670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf21a-177f-41a6-87a3-7ba64d9e6a0d None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:49.458273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:49.463717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe339f1-a0db-48c8-aed4-5c1f2fdd8adf None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:49.464147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe339f1-a0db-48c8-aed4-5c1f2fdd8adf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:49.464279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe339f1-a0db-48c8-aed4-5c1f2fdd8adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:49.482091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3fe339f1-a0db-48c8-aed4-5c1f2fdd8adf None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:49.483281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3fe339f1-a0db-48c8-aed4-5c1f2fdd8adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:49.491301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:49.529403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf21a-177f-41a6-87a3-7ba64d9e6a0d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:49.540498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf21a-177f-41a6-87a3-7ba64d9e6a0d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:49.543987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:49.544610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:49.544897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:49.545179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:49.554095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:49.555527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349289-694f-4bdf-8eca-736e5a937064 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:49.565448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 719/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:51.712032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884cfe-de4f-4801-ac09-3e497e430aab None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:51.712475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884cfe-de4f-4801-ac09-3e497e430aab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:51.712609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19884cfe-de4f-4801-ac09-3e497e430aab None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:51.713965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:51.719893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ead6-e376-45ef-9812-359a845492e3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:51.720321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ead6-e376-45ef-9812-359a845492e3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:51.720460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ead6-e376-45ef-9812-359a845492e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:51.737833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8034ead6-e376-45ef-9812-359a845492e3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:51.739038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8034ead6-e376-45ef-9812-359a845492e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:51.746768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:51.785142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19884cfe-de4f-4801-ac09-3e497e430aab None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:51.795701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19884cfe-de4f-4801-ac09-3e497e430aab None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:51.799372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:51.800064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:51.800344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:51.800646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:51.809553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:51.810977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea6f42-4083-4ab0-8f3e-ac409452d724 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:51.820675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 732/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:53.892335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d6dd-4f43-4d16-af65-18495d286d86 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:53.892921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d6dd-4f43-4d16-af65-18495d286d86 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:53.892921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d6dd-4f43-4d16-af65-18495d286d86 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:53.894266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:53.899474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd15d5-08d0-4140-8741-acab052bb768 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:53.899897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd15d5-08d0-4140-8741-acab052bb768 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:53.900064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd15d5-08d0-4140-8741-acab052bb768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:53.917961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a5fd15d5-08d0-4140-8741-acab052bb768 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:53.919147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a5fd15d5-08d0-4140-8741-acab052bb768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:53.926889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:53.964292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d6dd-4f43-4d16-af65-18495d286d86 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:53.975337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d6dd-4f43-4d16-af65-18495d286d86 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:53.978722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:53.979336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:53.979654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:53.979932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:53.988773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:53.990620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedea4-1ce3-4b8e-ad63-6584be3efe6a service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:54.002823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 722/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:56.085594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996486-3554-48d8-953d-4ee3c2b059c0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:56.086235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996486-3554-48d8-953d-4ee3c2b059c0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:56.086235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996486-3554-48d8-953d-4ee3c2b059c0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:56.087722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:56.092889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911dab-ec7d-476b-8414-f59bc310eb3b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:56.093816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911dab-ec7d-476b-8414-f59bc310eb3b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:56.094066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4911dab-ec7d-476b-8414-f59bc310eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:56.111163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a4911dab-ec7d-476b-8414-f59bc310eb3b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:56.112369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a4911dab-ec7d-476b-8414-f59bc310eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:56.119882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:56.157567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996486-3554-48d8-953d-4ee3c2b059c0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:56.168087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996486-3554-48d8-953d-4ee3c2b059c0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:56.171732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:56.172306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:56.172589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:56.172865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:56.181728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:56.183160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01123e8-1dc4-447b-b903-70dc5d05f351 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:56.192529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 735/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 05:59:58.288902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f636-ff5f-4443-9f8c-50f298812a01 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:58.289420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f636-ff5f-4443-9f8c-50f298812a01 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:58.289527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f636-ff5f-4443-9f8c-50f298812a01 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:58.290820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 05:59:58.295952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726f87-df58-4beb-8e94-50f8048cf4c1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:58.296405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726f87-df58-4beb-8e94-50f8048cf4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:58.296542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726f87-df58-4beb-8e94-50f8048cf4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:58.313765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-02726f87-df58-4beb-8e94-50f8048cf4c1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 05:59:58.314954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-02726f87-df58-4beb-8e94-50f8048cf4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 05:59:58.322710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 05:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 05:59:58.360562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f636-ff5f-4443-9f8c-50f298812a01 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 05:59:58.371002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f636-ff5f-4443-9f8c-50f298812a01 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 05:59:58.374434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 05:59:58.375051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 05:59:58.375336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 05:59:58.375649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 05:59:58.384270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 05:59:58.385690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e61de-b6c3-4391-a10a-82b67f735272 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 05:59:58.395432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 725/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 05:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:00.468188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7dc0-19e6-4cc4-ac15-c9c52196c34e None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:00.468715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7dc0-19e6-4cc4-ac15-c9c52196c34e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:00.468715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f7dc0-19e6-4cc4-ac15-c9c52196c34e None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:00.470106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:00.475494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e681-b07f-4b21-a111-1b8d1873cf40 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:00.475937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e681-b07f-4b21-a111-1b8d1873cf40 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:00.476086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208e681-b07f-4b21-a111-1b8d1873cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:00.482042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=79 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:00:00.494922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8208e681-b07f-4b21-a111-1b8d1873cf40 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:00.496142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8208e681-b07f-4b21-a111-1b8d1873cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:00.504412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:00.541368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f7dc0-19e6-4cc4-ac15-c9c52196c34e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:00.547291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=73 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:00:00.553674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f7dc0-19e6-4cc4-ac15-c9c52196c34e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:00.557210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:00.557843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:00.558130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:00.558409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:00.567960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:00.569396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30699c-1e0b-4aab-8d85-18be3f1ac3f1 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:00.578996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 738/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:02.639347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fa89-7c31-4a64-b912-bea9776a8557 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:02.639935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fa89-7c31-4a64-b912-bea9776a8557 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:02.639935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fa89-7c31-4a64-b912-bea9776a8557 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:02.641299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:02.646520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34dcd-33fe-4159-8c73-8aa0acd91200 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:02.646935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34dcd-33fe-4159-8c73-8aa0acd91200 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:02.647110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34dcd-33fe-4159-8c73-8aa0acd91200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:02.664848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-90a34dcd-33fe-4159-8c73-8aa0acd91200 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:02.666024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-90a34dcd-33fe-4159-8c73-8aa0acd91200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:02.675799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:02.711628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327fa89-7c31-4a64-b912-bea9776a8557 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:02.722519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327fa89-7c31-4a64-b912-bea9776a8557 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:02.725934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:02.726548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:02.726827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:02.727100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:02.735866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:02.737275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d68a-b565-4d5d-a63c-2468ef7524a4 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:02.746432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 728/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:04.785737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc6f8-9337-4606-9a41-d72d6704b2b0 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:04.786274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc6f8-9337-4606-9a41-d72d6704b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:04.786274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acc6f8-9337-4606-9a41-d72d6704b2b0 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:04.787778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:04.793107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ae5-fae1-4189-838e-8a382cf21bb4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:04.793545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ae5-fae1-4189-838e-8a382cf21bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:04.793646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ae5-fae1-4189-838e-8a382cf21bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:04.811336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-99510ae5-fae1-4189-838e-8a382cf21bb4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:04.812575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-99510ae5-fae1-4189-838e-8a382cf21bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:04.820292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:04.856438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc6f8-9337-4606-9a41-d72d6704b2b0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:04.867440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acc6f8-9337-4606-9a41-d72d6704b2b0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:04.870887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:04.871529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:04.871830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:04.872108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:04.880828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:04.882255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e20f6-8cba-4349-90cd-76757232858e service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:04.891428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 741/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:14.806404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=11 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:00:14.887316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=14 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:00:24.578720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32c8b-99e0-4a57-95a3-4aef35d957da None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:24.579257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32c8b-99e0-4a57-95a3-4aef35d957da None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:24.579257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32c8b-99e0-4a57-95a3-4aef35d957da None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:24.580593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 730/1471] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:24.586206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea40fa-c909-44ed-a1a9-b6993e88bcf8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:24.586605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea40fa-c909-44ed-a1a9-b6993e88bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:24.586768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea40fa-c909-44ed-a1a9-b6993e88bcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:24.604975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-11ea40fa-c909-44ed-a1a9-b6993e88bcf8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:24.606164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-11ea40fa-c909-44ed-a1a9-b6993e88bcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:24.614004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 742/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:24.661189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b868a1-ce54-44f5-abd7-255347f3ef01 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:24.661491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b868a1-ce54-44f5-abd7-255347f3ef01 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:24.661783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b868a1-ce54-44f5-abd7-255347f3ef01 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:24.663167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 731/1473] 10.222.0.13 () {54 vars in 962 bytes} [Wed Jun 22 06:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:24.667961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c6b-aa02-4e28-8313-f5a0b7599413 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:24.668245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c6b-aa02-4e28-8313-f5a0b7599413 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:24.668516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c6b-aa02-4e28-8313-f5a0b7599413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:24.686622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e9059c6b-aa02-4e28-8313-f5a0b7599413 None None] MFA Rules not processed for user `3c6d629e689d45d4b28b24b7f3d0d3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:24.687848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e9059c6b-aa02-4e28-8313-f5a0b7599413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:24.694079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 743/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Jun 22 06:00:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:24.700944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b868a1-ce54-44f5-abd7-255347f3ef01 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:24.712084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b868a1-ce54-44f5-abd7-255347f3ef01 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:24.715608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:24.716222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:24.716505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:24.716782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:24.725996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:24.727412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc452-9e81-49c4-b7ca-bab1c9e1ca6a service glance] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:24.736694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 732/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:00:26.824375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261166b8-f37c-44b6-9560-18175e86ab6f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:26.824911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261166b8-f37c-44b6-9560-18175e86ab6f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:26.824911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261166b8-f37c-44b6-9560-18175e86ab6f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:26.826341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 744/1476] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:26.831902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6153e-0159-40e0-ba83-20062a0ed2f2 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:26.832349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6153e-0159-40e0-ba83-20062a0ed2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:26.832461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6153e-0159-40e0-ba83-20062a0ed2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:26.850430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-34d6153e-0159-40e0-ba83-20062a0ed2f2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:26.851629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-34d6153e-0159-40e0-ba83-20062a0ed2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:26.859185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 733/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:26.883304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261166b8-f37c-44b6-9560-18175e86ab6f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:26.895962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261166b8-f37c-44b6-9560-18175e86ab6f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:26.900378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:26.901009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:26.901291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:26.901565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:26.902291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:26.904121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:00:26.904121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:00:26.904121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:00:26.905265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67c15-77f3-430e-99ac-0eaa41359f0e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:26.924448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 745/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Jun 22 06:00:26 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:00:28.955024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38a7c-7575-42b8-b1df-53401a1b1539 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:28.955581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38a7c-7575-42b8-b1df-53401a1b1539 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:28.955581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d38a7c-7575-42b8-b1df-53401a1b1539 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:28.956967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 734/1479] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:28.962437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009062-c6aa-411a-a5f4-a6f7d09cc0e1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:28.962840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009062-c6aa-411a-a5f4-a6f7d09cc0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:28.963000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009062-c6aa-411a-a5f4-a6f7d09cc0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:28.981007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4b009062-c6aa-411a-a5f4-a6f7d09cc0e1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:28.982215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4b009062-c6aa-411a-a5f4-a6f7d09cc0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:28.991346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 746/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:29.034053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d38a7c-7575-42b8-b1df-53401a1b1539 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:29.048012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d38a7c-7575-42b8-b1df-53401a1b1539 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:29.053209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:29.053827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:29.054105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:29.054377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:29.062240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:29.063835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1e73-8506-4a24-b087-3fce9d537f40 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:29.072989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 735/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:31.264282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf1aa-fdad-4e66-b02f-8d4900c8a22d None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:31.264788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf1aa-fdad-4e66-b02f-8d4900c8a22d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:31.264901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbf1aa-fdad-4e66-b02f-8d4900c8a22d None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:31.266261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 747/1482] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:31.271289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b17c3f-b116-41f4-b745-ff7e0e6000a3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:31.271697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b17c3f-b116-41f4-b745-ff7e0e6000a3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:31.271874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b17c3f-b116-41f4-b745-ff7e0e6000a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:31.289316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b0b17c3f-b116-41f4-b745-ff7e0e6000a3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:31.290501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b0b17c3f-b116-41f4-b745-ff7e0e6000a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:31.298786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 736/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:31.334988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbf1aa-fdad-4e66-b02f-8d4900c8a22d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:31.345611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbf1aa-fdad-4e66-b02f-8d4900c8a22d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:31.349152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:31.349780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:31.350068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:31.350347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:31.359067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:31.361030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244050d-66d5-473e-a551-4bf0bd05ac8e service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:31.370304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 748/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:33.434583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:33.435131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:33.435131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:33.436524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 737/1485] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:33.442307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f96-0f9f-4902-875a-c8ece0532f3e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:33.442746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f96-0f9f-4902-875a-c8ece0532f3e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:33.442867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9f96-0f9f-4902-875a-c8ece0532f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:33.460597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-571c9f96-0f9f-4902-875a-c8ece0532f3e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:33.461787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-571c9f96-0f9f-4902-875a-c8ece0532f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:33.469550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 749/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:33.507984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:33.509654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:33.522360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec6fe-9ed2-4b43-8fa0-0b939514b3d0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:33.525905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:33.526531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:33.527331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:33.527654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:33.540323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:33.541795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa624-8b40-45e2-b534-a2cfcbd0bded service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:33.555410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 738/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:35.746780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f496-dfb3-4576-8f5d-86ed5eed398f None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:35.747316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f496-dfb3-4576-8f5d-86ed5eed398f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:35.747451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0f496-dfb3-4576-8f5d-86ed5eed398f None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:35.748802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 750/1488] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:35.754631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292ad87-9c8c-4307-bf61-3b27e96c996b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:35.755036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292ad87-9c8c-4307-bf61-3b27e96c996b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:35.755192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292ad87-9c8c-4307-bf61-3b27e96c996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:35.773067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9292ad87-9c8c-4307-bf61-3b27e96c996b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:35.774251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9292ad87-9c8c-4307-bf61-3b27e96c996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:35.781921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 739/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:35.822561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0f496-dfb3-4576-8f5d-86ed5eed398f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:35.833117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0f496-dfb3-4576-8f5d-86ed5eed398f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:35.836882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:35.837504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:35.837790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:35.838068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:35.846765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:35.848222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c3dbf-fa70-4e47-b225-156992a0e5e9 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:35.857424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 751/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:38.045719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4b1-3786-4d3f-a642-e822d8b40c04 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:38.046283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4b1-3786-4d3f-a642-e822d8b40c04 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:38.046283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4b1-3786-4d3f-a642-e822d8b40c04 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:38.048196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 740/1491] 10.222.0.13 () {54 vars in 926 bytes} [Wed Jun 22 06:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:00:38.053474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ba9f6-bad5-435e-9caf-448bcf121b66 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:38.053882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ba9f6-bad5-435e-9caf-448bcf121b66 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:38.054032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ba9f6-bad5-435e-9caf-448bcf121b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:38.071744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-145ba9f6-bad5-435e-9caf-448bcf121b66 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:00:38.072922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-145ba9f6-bad5-435e-9caf-448bcf121b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:00:38.080601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 752/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Wed Jun 22 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:00:38.120594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a4b1-3786-4d3f-a642-e822d8b40c04 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:00:38.131646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a4b1-3786-4d3f-a642-e822d8b40c04 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:00:38.135029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:00:38.135691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:00:38.135973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:00:38.136248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:00:38.144850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:00:38.146262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc5d6-a6f5-457e-8b78-d8e1ac137467 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:00:38.155342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 741/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:00:48.066733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=33 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:00:48.151269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=33 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:02:02.255132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.255650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.255773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.273551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:02:02.274748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:02.282901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 753/1494] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:02:02.291960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.292447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.292552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.309804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:02:02.310966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:02.319055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 742/1495] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:02:02.323396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.333373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfd05d-ed63-425c-8c00-989fe4ef1703 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.338073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.338714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.338994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.339270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.340019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:02:02.340329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.341336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.341336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:02:02.341336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:02:02.342204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.353365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 754/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:02:02.361029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.369844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23634c5-0d1e-44f9-9566-5e5e34c33c3b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.374247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.375388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.375702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.375969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.376645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.378390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.378390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:02:02.378390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:02:02.379594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.415724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 743/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:02:02.419911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.429832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6c98-1827-4ae0-a097-312e6ff1d14d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.484430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.485050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.485300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.485645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.486277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.487311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.487311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:02:02.487311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:02:02.488543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.507089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 755/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:02:02.511303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.522184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439dcec-7603-419f-898c-34fbc1a25794 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.526645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.527291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.527605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.527883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.528600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.529623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.529623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:02:02.529623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:02:02.530500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.543007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 744/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:02:02.546928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.556513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e02f8d-7461-4cc0-ac37-ef9d112e4c62 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.561084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.561723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.562536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.562810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.563544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.564548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.564548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:02:02.564548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:02:02.565419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4c661-942b-44ff-865a-561c90b2c107 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.579202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 756/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:02:02.583295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.593204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8eaf-9ff4-43dd-b9be-e95f5541eb8a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.597682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.598564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.598843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.599114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] PATH_INFO: `/v3/projects/d1d225adfe5a4291bd854ca001941b87/users/300030ed270a4be8847e5febed3078f2/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.613375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d225adfe5a4291bd854ca001941b87, user_id=300030ed270a4be8847e5febed3078f2, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.614391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.614391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:02:02.614391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:02:02.616337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b59b3-2b9e-4dbf-af22-e585380ae4db admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.630375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 745/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:02:02 2022] PUT /identity/v3/projects/d1d225adfe5a4291bd854ca001941b87/users/300030ed270a4be8847e5febed3078f2/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:02:02.642216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15dda-3464-4e93-bf0f-63fd968d7068 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.642506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15dda-3464-4e93-bf0f-63fd968d7068 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.642784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15dda-3464-4e93-bf0f-63fd968d7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.668003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-56a15dda-3464-4e93-bf0f-63fd968d7068 None None] MFA Rules not processed for user `300030ed270a4be8847e5febed3078f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:02:02.669207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-56a15dda-3464-4e93-bf0f-63fd968d7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:02.731374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 757/1502] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:02:02.745192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59c73c-9dc5-453e-9117-fd4e94215c17 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.745506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59c73c-9dc5-453e-9117-fd4e94215c17 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.745784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59c73c-9dc5-453e-9117-fd4e94215c17 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.747163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 746/1503] 10.222.0.13 () {54 vars in 963 bytes} [Wed Jun 22 06:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:02:02.752450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952e18-af88-4cc4-99a1-c33dc4ab8a26 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.752736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952e18-af88-4cc4-99a1-c33dc4ab8a26 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.753010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952e18-af88-4cc4-99a1-c33dc4ab8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.770262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f5952e18-af88-4cc4-99a1-c33dc4ab8a26 None None] MFA Rules not processed for user `47e0e69820cb4c269c1d6043d70380f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:02:02.771466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f5952e18-af88-4cc4-99a1-c33dc4ab8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:02.813321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:02:02.821354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 758/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Jun 22 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:02:02.828852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59c73c-9dc5-453e-9117-fd4e94215c17 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.839598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59c73c-9dc5-453e-9117-fd4e94215c17 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.843052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.843712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.843994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.844270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.852299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.853708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:02.862799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 747/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:02:02.904027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51789-22a1-48e7-8466-31710549d277 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.904384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51789-22a1-48e7-8466-31710549d277 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.904669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb51789-22a1-48e7-8466-31710549d277 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.906023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 759/1506] 10.222.0.13 () {52 vars in 829 bytes} [Wed Jun 22 06:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:02:02.909634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:02.969729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb21c9-6b7d-4cdf-98b5-8218afd53435 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:02.974206 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:02.975056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:02.975338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:02.975644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] PATH_INFO: `/v3/users/300030ed270a4be8847e5febed3078f2` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:02.976815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=300030ed270a4be8847e5febed3078f2)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:02.977823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:02.977823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:02:02.977823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:02:02.979018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:03.041288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300030ed270a4be8847e5febed3078f2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.059659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300030ed270a4be8847e5febed3078f2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.060433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300030ed270a4be8847e5febed3078f2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.061044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300030ed270a4be8847e5febed3078f2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.070485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300030ed270a4be8847e5febed3078f2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.079013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:02:03.089875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 748/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:02:02 2022] DELETE /identity/v3/users/300030ed270a4be8847e5febed3078f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:02:03.094665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:03.095013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:03.095312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:03.116148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:02:03.117340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:03.174168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 760/1508] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:02:03.183495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:03.184934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:03.241434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7b1c-6f4a-47b0-a482-b7adf41cba3a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:03.245076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:03.245723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:03.246009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:03.246285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:03.255278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:03.256749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d78aa4-a11f-4828-badf-ec4dcacf69e3 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:03.266045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 749/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:02:03.584622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:02:03.586105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:02:03.598769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e65737-5c59-4297-b8dd-8c6f028af0b6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:02:03.603730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:02:03.604719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:02:03.605010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:02:03.605312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] PATH_INFO: `/v3/projects/d1d225adfe5a4291bd854ca001941b87` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:02:03.607247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d225adfe5a4291bd854ca001941b87)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:02:03.608503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:02:03.608503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:02:03.608503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:02:03.609718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:02:03.670381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d225adfe5a4291bd854ca001941b87', 'request_id': 'req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.679833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d225adfe5a4291bd854ca001941b87', 'request_id': 'req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.685813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d225adfe5a4291bd854ca001941b87', 'request_id': 'req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.704320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] The token cache is being invalidate because project d1d225adfe5a4291bd854ca001941b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:02:03.704629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.705276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2b14707f-ef1c-45b6-bba9-45cc81dfbb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:02:03.706904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 761/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:02:03 2022] DELETE /identity/v3/projects/d1d225adfe5a4291bd854ca001941b87 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:02:13.261928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=29 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:02:13.700805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:03:38.920166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:38.920814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:38.920814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:38.922187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 06:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:38.927106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670c54-88ad-442a-a4c0-37f3a9552f1a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:38.927579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670c54-88ad-442a-a4c0-37f3a9552f1a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:38.927687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4670c54-88ad-442a-a4c0-37f3a9552f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:38.945608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b4670c54-88ad-442a-a4c0-37f3a9552f1a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:38.946799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b4670c54-88ad-442a-a4c0-37f3a9552f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:39.003047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 06:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:39.157788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:39.159478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:39.233476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36049ffe-ce0d-4914-bf22-c289ae0fa813 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:39.238747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:39.239386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:39.239693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:39.239967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:39.247887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:39.249459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75612030-6b77-45c3-8c8e-ccf4dbcedbb7 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:39.259198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 751/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:40.088235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b975-a560-4513-8563-369d473cd78a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:40.088846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b975-a560-4513-8563-369d473cd78a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:40.088846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b975-a560-4513-8563-369d473cd78a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:40.090105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 06:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:40.095031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e658e3-81ff-4a03-84be-5f0c243e85c6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:40.095590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e658e3-81ff-4a03-84be-5f0c243e85c6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:40.095699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e658e3-81ff-4a03-84be-5f0c243e85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:40.118498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c0e658e3-81ff-4a03-84be-5f0c243e85c6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:40.119747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c0e658e3-81ff-4a03-84be-5f0c243e85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:40.127582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:40.280490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b975-a560-4513-8563-369d473cd78a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:40.294980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b975-a560-4513-8563-369d473cd78a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:40.300242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:40.300863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:40.301142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:40.301415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:40.309879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:40.311471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ca86-71cb-4bf7-a239-9e5363f1effd service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:40.321548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 764/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:40.908303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1deb6-7d86-46c2-af3c-c1429994e1e7 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:40.908590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1deb6-7d86-46c2-af3c-c1429994e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:40.908864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1deb6-7d86-46c2-af3c-c1429994e1e7 None None] PATH_INFO: `/v3` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:40.910177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 753/1517] 10.222.0.55 () {54 vars in 925 bytes} [Wed Jun 22 06:03:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:03:40.917521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba9ab-7bf3-44cc-a4f6-d37255d208c5 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:40.917814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba9ab-7bf3-44cc-a4f6-d37255d208c5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:40.918434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba9ab-7bf3-44cc-a4f6-d37255d208c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:40.936354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7ceba9ab-7bf3-44cc-a4f6-d37255d208c5 None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:40.937559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7ceba9ab-7bf3-44cc-a4f6-d37255d208c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:41.000107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 765/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 22 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:44.940695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd86cf-4bf4-493b-837a-39aa30160e97 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:44.941271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd86cf-4bf4-493b-837a-39aa30160e97 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:44.941549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd86cf-4bf4-493b-837a-39aa30160e97 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:44.943942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 754/1519] 10.222.0.13 () {54 vars in 960 bytes} [Wed Jun 22 06:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:44.949001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d723-eb83-4fca-bfaf-2c187d9267ad None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:44.949468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d723-eb83-4fca-bfaf-2c187d9267ad None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:44.949580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d723-eb83-4fca-bfaf-2c187d9267ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:44.968875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-acd1d723-eb83-4fca-bfaf-2c187d9267ad None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:44.970079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-acd1d723-eb83-4fca-bfaf-2c187d9267ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:44.980199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 766/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Jun 22 06:03:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:44.988004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd86cf-4bf4-493b-837a-39aa30160e97 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:45.002939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd86cf-4bf4-493b-837a-39aa30160e97 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:45.008035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:45.008687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:45.008970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:45.009240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:45.018539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:45.020804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939a8b-4af8-4cea-88f9-efb6503dabb7 service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:45.030681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 755/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:51.537887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accfbcf-8140-44cd-9b7f-9c32b32f86b6 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:51.538389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accfbcf-8140-44cd-9b7f-9c32b32f86b6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:51.538389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accfbcf-8140-44cd-9b7f-9c32b32f86b6 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:51.539772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 06:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:51.544481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc547e1-71a1-4211-b06b-28108e766674 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:51.544897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc547e1-71a1-4211-b06b-28108e766674 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:51.545042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc547e1-71a1-4211-b06b-28108e766674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:51.563289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4cc547e1-71a1-4211-b06b-28108e766674 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:51.564511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4cc547e1-71a1-4211-b06b-28108e766674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:51.572888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 06:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:51.728823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accfbcf-8140-44cd-9b7f-9c32b32f86b6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:51.743571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accfbcf-8140-44cd-9b7f-9c32b32f86b6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:51.748928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:51.749559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:51.749847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:51.750124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:51.758152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:51.759779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56ffe-5d05-4365-856c-76a49ca12c6c service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:51.768958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 768/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:52.586511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994797-bcc9-4856-bd27-c666a3b8abc0 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:52.587293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994797-bcc9-4856-bd27-c666a3b8abc0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:52.587293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994797-bcc9-4856-bd27-c666a3b8abc0 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:52.588691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 06:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:52.593789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388759c-8eb5-46ae-a96a-7575410972cc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:52.594186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388759c-8eb5-46ae-a96a-7575410972cc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:52.594346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388759c-8eb5-46ae-a96a-7575410972cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:52.612616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1388759c-8eb5-46ae-a96a-7575410972cc None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:52.613807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1388759c-8eb5-46ae-a96a-7575410972cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:52.622264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 06:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:52.778424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05994797-bcc9-4856-bd27-c666a3b8abc0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:52.792783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05994797-bcc9-4856-bd27-c666a3b8abc0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:52.798031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:52.798679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:52.798961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:52.799237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:52.807729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:52.809297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d8a9-7f01-4a5d-a1ff-612ca16bfba6 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:52.818480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 758/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:56.622056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:56.622634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:56.622634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:56.624041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:56.629351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720ce8-ab1c-42c5-a36a-d1507fffdb99 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:56.629752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720ce8-ab1c-42c5-a36a-d1507fffdb99 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:56.629916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720ce8-ab1c-42c5-a36a-d1507fffdb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:56.647976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a9720ce8-ab1c-42c5-a36a-d1507fffdb99 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:56.649165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a9720ce8-ab1c-42c5-a36a-d1507fffdb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:56.656902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:56.693240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:56.694911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:56.751040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb024db-ad87-4480-80ca-6243e5e9093a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:56.754526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:56.755155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:56.755442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:56.755748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:56.764456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:56.765871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01670f0f-237d-487a-8ab9-e877185f9d5f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:56.770686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:03:56.776223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 771/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:03:58.795744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df187-7440-4f31-826f-c9c1083971cb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:58.796330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df187-7440-4f31-826f-c9c1083971cb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:58.796330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482df187-7440-4f31-826f-c9c1083971cb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:58.797693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:03:58.803263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403acaa-6672-4c1d-a0dd-36c4672dd75d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:58.803717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403acaa-6672-4c1d-a0dd-36c4672dd75d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:58.803867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403acaa-6672-4c1d-a0dd-36c4672dd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:58.823339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e403acaa-6672-4c1d-a0dd-36c4672dd75d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:03:58.824551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e403acaa-6672-4c1d-a0dd-36c4672dd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:03:58.832126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:03:58.868459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482df187-7440-4f31-826f-c9c1083971cb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:03:58.878886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482df187-7440-4f31-826f-c9c1083971cb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:03:58.882418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:03:58.883035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:03:58.883311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:03:58.883619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:03:58.892209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:03:58.893605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfb45a-b5d6-43ba-8977-ecf1005b129f service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:03:58.903306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 761/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:04:02.522044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:02.522554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:02.522554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:02.523951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:04:02.529109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c595d-ca5d-4be9-8ddb-b745231711ef None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:02.529527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c595d-ca5d-4be9-8ddb-b745231711ef None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:02.530149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c595d-ca5d-4be9-8ddb-b745231711ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:02.548213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-789c595d-ca5d-4be9-8ddb-b745231711ef None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:04:02.549387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-789c595d-ca5d-4be9-8ddb-b745231711ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:04:02.557332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:04:02.854659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:04:02.856365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:04:02.911468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e468e-ef56-4225-916e-6377be981347 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:04:02.915530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:04:02.916168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:02.916451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:02.916727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:02.925513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:04:02.926932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df052f12-44dc-4561-a33e-10d10b20a9ee service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:04:02.936740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 774/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:04:04.986074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:04.986664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:04.986664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:04.988031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 06:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:04:04.993301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee498-4948-43d4-ac0f-155a7b344e41 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:04.993715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee498-4948-43d4-ac0f-155a7b344e41 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:04.993857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee498-4948-43d4-ac0f-155a7b344e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:05.011685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ff5ee498-4948-43d4-ac0f-155a7b344e41 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:04:05.012870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ff5ee498-4948-43d4-ac0f-155a7b344e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:04:05.020718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 06:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:04:05.322446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:04:05.324097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:04:05.331423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=65 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:04:05.338020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9203-9c35-4fd1-8cca-e360afb61052 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:04:05.341463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:04:05.342081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:04:05.342359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:04:05.342633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:04:05.352159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:04:05.353557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924b47-6ba6-4a6f-8026-fdaf6aa028c3 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:04:05.362714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 764/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:04:15.006910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=32 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:04:15.358692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:34.000157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.000900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.000900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.024846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.026419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.038144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 776/1540] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:05:34.048830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2f04-8d55-44b5-a79f-9f6cdae6faa2 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.049417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2f04-8d55-44b5-a79f-9f6cdae6faa2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.049417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2f04-8d55-44b5-a79f-9f6cdae6faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.072713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-642c2f04-8d55-44b5-a79f-9f6cdae6faa2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.073940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-642c2f04-8d55-44b5-a79f-9f6cdae6faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.090926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 765/1541] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.096496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.113490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bf39-5b9c-484b-9eac-55091d10dc69 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.121934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.123020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.123972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.124487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.125505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.126041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.128112 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.149415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 777/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.150582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a9fc-197c-4871-b3f5-25f2d1a1b49a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.151022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a9fc-197c-4871-b3f5-25f2d1a1b49a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.151307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a9fc-197c-4871-b3f5-25f2d1a1b49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.176624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ad55a9fc-197c-4871-b3f5-25f2d1a1b49a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.177836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ad55a9fc-197c-4871-b3f5-25f2d1a1b49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.181198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.193666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 766/1543] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.198320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b5af-cdc5-4908-b057-de69c60a0c35 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.205248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.205573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.205816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.212814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.213964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.214467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.214967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.215946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.217519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:34.217519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:05:34.217519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:05:34.219176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4814-98e0-43ad-a299-5780bed167aa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.237529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.238746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.252319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 767/1544] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:05:34.256500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.270253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b23368-23db-4d06-a428-7b35da775463 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.275875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.276551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.276831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.277102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.277918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.278230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.279222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:34.279222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:05:34.279222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:05:34.280936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 778/1545] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:05:34.282644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0b58-db1c-4fdc-a344-cbce2c841139 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.283155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0b58-db1c-4fdc-a344-cbce2c841139 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.287064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0b58-db1c-4fdc-a344-cbce2c841139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.288398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.305147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 768/1546] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:05:34.305979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.318517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-57aa0b58-db1c-4fdc-a344-cbce2c841139 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.320727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-57aa0b58-db1c-4fdc-a344-cbce2c841139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.321673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec02c7-942c-4e79-9323-c50497f26c9a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.392569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.393240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.393524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.393808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.394491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.395529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:34.395529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:05:34.395529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:05:34.396758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.404088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 779/1547] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.405910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ca1f-34df-4a75-b336-3771e38e18d9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.406439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ca1f-34df-4a75-b336-3771e38e18d9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.407045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ca1f-34df-4a75-b336-3771e38e18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.422049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 769/1548] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:34.423214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.427749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6492ca1f-34df-4a75-b336-3771e38e18d9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.428963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6492ca1f-34df-4a75-b336-3771e38e18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.434773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1e6d-e196-42dc-a982-6eddac9a6a70 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.437884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 780/1549] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.442742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.442742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.442742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.442742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.443189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.445623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead891e-eedb-4bdd-a819-1912ae1889a0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.445743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfddfc-523e-46d8-b581-149051ddd134 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.445954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfddfc-523e-46d8-b581-149051ddd134 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.446191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfddfc-523e-46d8-b581-149051ddd134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.467169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-aabfddfc-523e-46d8-b581-149051ddd134 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.468402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-aabfddfc-523e-46d8-b581-149051ddd134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.472574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 770/1550] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:34.474150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3f663-559f-4d27-8cc1-53310696a76f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.474442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3f663-559f-4d27-8cc1-53310696a76f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.474721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3f663-559f-4d27-8cc1-53310696a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.477274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 781/1551] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.478542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.478826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.479106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.495435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-45d3f663-559f-4d27-8cc1-53310696a76f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.496659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-45d3f663-559f-4d27-8cc1-53310696a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.498467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.499674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.555588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 771/1552] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.556782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa69b4-262a-43f2-9ea8-08871c086c3e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.557070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa69b4-262a-43f2-9ea8-08871c086c3e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.557361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa69b4-262a-43f2-9ea8-08871c086c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.566879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 782/1553] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.567881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.578195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a83b5d-691c-4a92-9866-aed9714263e3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.581323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-52aa69b4-262a-43f2-9ea8-08871c086c3e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.582530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-52aa69b4-262a-43f2-9ea8-08871c086c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.582826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.583486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.583797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.584072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.584795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.586985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2143231-577d-4bd7-806a-835af513b3fc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.591696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 772/1554] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.593087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b406f-41a7-4603-994c-d778014485da None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.593372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b406f-41a7-4603-994c-d778014485da None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.593646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b406f-41a7-4603-994c-d778014485da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.601722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 783/1555] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:34.602896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05670cd-56cb-418e-bacc-ab24a5f89c7c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.603166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05670cd-56cb-418e-bacc-ab24a5f89c7c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.603448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05670cd-56cb-418e-bacc-ab24a5f89c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.612966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-cf7b406f-41a7-4603-994c-d778014485da None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.614176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-cf7b406f-41a7-4603-994c-d778014485da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.621855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c05670cd-56cb-418e-bacc-ab24a5f89c7c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.622545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 773/1556] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.623008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c05670cd-56cb-418e-bacc-ab24a5f89c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.623279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b406f-41a7-4603-994c-d778014485da None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.631101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 784/1557] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.632197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f731b-ff26-42e5-adbf-9561cdb4837f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.632504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f731b-ff26-42e5-adbf-9561cdb4837f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.633190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b406f-41a7-4603-994c-d778014485da None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.633301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f731b-ff26-42e5-adbf-9561cdb4837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.637661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.638308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.638594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.638871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.639585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.641493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89dc4c-aa36-4a33-9162-8944b148e725 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.651262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2f9f731b-ff26-42e5-adbf-9561cdb4837f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.652500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2f9f731b-ff26-42e5-adbf-9561cdb4837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.661388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 785/1558] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.666190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 774/1559] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/users => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:34.666326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.666326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.666326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.666612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.666612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.666612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.672053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:34.684318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.685399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.685539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.686575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.693572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 786/1560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.694548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.694673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 775/1561] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.699172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.704526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cde61-1561-4e93-b162-067ecba7ee20 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.708507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455c3cd-150b-4bf7-98cc-dd95d66bc6a3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.709052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.709700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.709983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.710260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.711249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.711582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.713177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.713400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.714042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.714324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.714600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.715318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.716922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7af29-ca5c-4b34-8c19-894080c5b7bb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.725175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 787/1562] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.726054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.727540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 776/1563] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:34.728612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.728896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.729171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.738548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:34.745348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17c97-2889-4cf4-ab04-ff78e2348d8e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.750336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.750999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.751281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.751586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.752337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.752641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.754061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:34.754235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.755280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:34.763768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 777/1564] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:34.764565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.772981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 788/1565] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.772981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.774110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2106-fcc5-4adb-b20a-0d8584202800 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.778599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.779243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.779544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.779823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.780544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.780848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.782430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.782532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7591-74fe-4c2a-8f70-d46b41fec872 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.787013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.787685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.787971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.788247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.789533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.791091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.794584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 778/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.795370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.805354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 789/1567] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:34.805354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.808176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eb8e-92e8-4444-91a4-23e40bc7956e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.812752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.812921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f720c-a7b1-43a8-8458-426b09e5e65d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.813684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.814031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.814311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.815022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.815325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.816925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.818104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.818921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.819691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.820005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.820764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.821078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.822678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.828936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 779/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.829818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.842582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 790/1569] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.842582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.847565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357590-aa1b-4794-a0a9-da6533ffe92a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.847848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4e21a-3810-4688-b1cd-cbcd2e4245df admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.852532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.852811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.853155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.853436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.853666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.853781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.853948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.854220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] PATH_INFO: `/v3/projects/86b33f680fbf4294898251ada897ad9b/users/e49aee17a817492980a15f564b74da67/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.854401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.856314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.869290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b33f680fbf4294898251ada897ad9b, user_id=e49aee17a817492980a15f564b74da67, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.872075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.882980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 791/1570] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:34.883818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.885546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 780/1571] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:34 2022] PUT /identity/v3/projects/86b33f680fbf4294898251ada897ad9b/users/e49aee17a817492980a15f564b74da67/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:34.886481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.948135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406f3c6-c47d-4ec3-a3c3-b808165cf0f7 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.950561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb928-43e4-493e-b7cd-83c9802fa3f9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.952747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.953448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.953732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.954061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.954770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.955145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:34.955943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:34.956251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:34.956521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:34.956715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.957235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:34.957536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:34.959193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:34.970707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 792/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:34.971604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:34.982752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225f76-9058-4357-87ea-d3cd331da9f3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:34.983892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 781/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:34.984713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.043450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.044163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.044408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.044681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.045176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275fddd-8778-4562-a42d-d89f0de93417 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.045357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.047481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.049776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.050435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.050714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.050993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.051742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.053318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.063316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 782/1574] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.064121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.078075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 793/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:34 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.078075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.078362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d99ae-61b0-41b2-9fa0-b3f3d1dd1ab8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.085360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.105071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.136825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.137500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.137930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.138207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.138916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.140923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.144541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60ebb5-3c3c-4236-9734-dd8ce1bb6058 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.149949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.150623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.150947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.151222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.151936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.153822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d678d78-b85c-462d-9290-190395c0795e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.170798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 783/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.170798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.181931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 794/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.183328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.183711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.183990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.214358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] MFA Rules not processed for user `e49aee17a817492980a15f564b74da67`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:35.215636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:35.235159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15604ee-af66-42d5-ab1b-405c94460464 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.279215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 795/1578] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:35.283592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.294514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.295676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.296035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.296312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.297000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.298912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.321949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 784/1579] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.321949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.329613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006b460-effa-4a7c-9564-b185cddcb57d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.334230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.334864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.335148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.335425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.336680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.338579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.343321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0486c0c-9036-4f1b-874e-20a9caac4646 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.348090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.348775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.349092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.349445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.350171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.353064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.362556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 785/1580] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.362556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.370200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ab4d-be61-4e28-8fda-16445153d4b4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.374935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.375818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.376101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.376375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] PATH_INFO: `/v3/projects/46c0bf6b1c3546b7bc0b88e6edf581f7/users/dde622e34c10487a8e7cc1be4a9eef1e/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.378127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 796/1581] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.378920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.390832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.394296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c0bf6b1c3546b7bc0b88e6edf581f7, user_id=dde622e34c10487a8e7cc1be4a9eef1e, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.398767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.404576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.413384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 786/1582] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:35 2022] PUT /identity/v3/projects/46c0bf6b1c3546b7bc0b88e6edf581f7/users/dde622e34c10487a8e7cc1be4a9eef1e/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:35.417960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.442453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e763141-375d-4a7e-b46c-c54eeb93b935 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.474867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353f86-c8da-4d51-aef9-292b01fd7ec0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.479382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.480063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.480404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.480680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.481352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.483246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.498349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.499012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.499321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.499626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.500313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.502242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.502911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 787/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.503739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.514698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9bc8-7d24-41b0-a2fe-9db88b4e7dd6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.520118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.520760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.521038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.521309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.521987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.526736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 797/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.526736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.526946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.548328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 788/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.548328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.555495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21d0d-2cf0-48fe-b2b6-988471c2c4e8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.560113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.560753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.561042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.561323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.562056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.563649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.578668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 789/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.578668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.584369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b194e-edac-41e4-b7aa-78c3875587f4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.586749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77271f0-ac60-4e97-a298-3364acd1849e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.588612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.589843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.590126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.590401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.591350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.592009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.592293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.592571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.593280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.594855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.604873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 790/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.605667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.615612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f809d-d309-4774-83d2-871aa488e188 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.620346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.620982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.621267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.621613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.622292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.624210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dcd24-acaf-40c4-9863-efedf1733a02 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.650135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 791/1588] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:35.652553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.653296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.653706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.657289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.659871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.673756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 798/1589] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:35.674927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.678839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:35.680610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:35.690974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e726-fe38-4c36-8825-630ba99f2988 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.693579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 792/1590] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:35.695564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.702680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.703489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.704204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.704850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.705814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.707542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.712061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10558f-f2b7-4ffd-880b-c5e66ec44939 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.718249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.718898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.719156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 799/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.719268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.720025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.722521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.723288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.725061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.725205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.731006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c734-3247-47ab-9221-ff68f5bfd64c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.736070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.736724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.737007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.737282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.737996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.739617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.743129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 793/1592] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.743129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.751843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c3f-f91a-4e3d-9bba-9fac5dcb413f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.755296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 800/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.755296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.757306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.758512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.759063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.759313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.760252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.761971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.763811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5ced1-2d6e-4b29-a85f-75e7004c4fe9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.768776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.769428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.769708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.769989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.770710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.774165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 794/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.774284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.775419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.786284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3052-3320-4ef2-b581-378576e23c7b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.788163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 801/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.788874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.794223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.795040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.795419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.795787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.796575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.798216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.809325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 795/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.810114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.819939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0208d-caae-4f71-98bc-cb491a8733c1 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.825176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.825810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.826090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.826360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.827097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.828751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.839138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 796/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.839959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.849586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4d61b-e68c-45ed-bdf0-bf19541a488b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.854330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.854974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.855254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.855911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.856271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.857832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.859424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae9b5b-dd3a-46d1-aafd-1233a7ac8ee5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.863726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.863726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.864060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.864338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.869773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 797/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.870553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.874668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.876189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.880521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c61334-c0ba-4ddd-a6e6-c6b2f9695f6b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.886523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.886523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.886949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.887288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.888098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.889748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.891678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 802/1599] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:35.893429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.904488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ec1e-339e-40e3-a879-d9cc24f03b2d service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.909058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 798/1600] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:35.910385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.914799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.915824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.916208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.916893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] PATH_INFO: `/v3/projects/54589722a94841bba9e3b257c63b956e/users/72f6f036211a4cc9aa78ae4936b5b5be/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.923666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99ac8-c57f-4f2e-bdaf-8e4b66e5b782 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:35.932802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:35.933697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:35.933982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:35.934311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] PATH_INFO: `/v3/projects/a7c8d946d999424495e9965305422667/users/b470e4bbcf67422c860831db2f2d61af/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:35.934705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54589722a94841bba9e3b257c63b956e, user_id=72f6f036211a4cc9aa78ae4936b5b5be, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.936360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:35.936360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:05:35.936360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:05:35.938798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.946712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:35.958570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c8d946d999424495e9965305422667, user_id=b470e4bbcf67422c860831db2f2d61af, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:35.962330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:35.969447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 803/1601] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:35 2022] PUT /identity/v3/projects/54589722a94841bba9e3b257c63b956e/users/72f6f036211a4cc9aa78ae4936b5b5be/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:35.970533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:35.996787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 799/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:35 2022] PUT /identity/v3/projects/a7c8d946d999424495e9965305422667/users/b470e4bbcf67422c860831db2f2d61af/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:35.997541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.057275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a9cbe-6661-465b-bdb1-80e84248c735 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.100589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1150d51-ea60-4f34-9556-87edf0456365 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.107961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.109523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.109817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.110096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] PATH_INFO: `/v3/projects/34a7e0518c854cb0b70a8eb41935637c/users/b14d87e680334ea289b5a21c5b67d428/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.131918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a7e0518c854cb0b70a8eb41935637c, user_id=b14d87e680334ea289b5a21c5b67d428, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.136662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.155937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.156787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.157347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.157852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.159062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.161578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.164468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 800/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:35 2022] PUT /identity/v3/projects/34a7e0518c854cb0b70a8eb41935637c/users/b14d87e680334ea289b5a21c5b67d428/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:36.166821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.182863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 804/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:36.184100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.191857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:36.199946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51edbd-6f1e-4ccc-956d-5847abe658f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.255350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9107da-1446-4b6d-9ff8-a0a825f75f23 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.261203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.262881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.263308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.263724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] PATH_INFO: `/v3/projects/b5209c2872554c80b1fc770f46d4dda8/users/0690e45336654d62839d7bfdf779a577/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.285129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5209c2872554c80b1fc770f46d4dda8, user_id=0690e45336654d62839d7bfdf779a577, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.288033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.288467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.289284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.289400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef9d5-1b35-4617-9ab4-91fb80c76e11 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.289570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] PATH_INFO: `/v3/projects/8f184693bc4049f0b6767ae7361cac20/users/4345d08b42bf4097bf8f3d84f9df70b8/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.308408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f184693bc4049f0b6767ae7361cac20, user_id=4345d08b42bf4097bf8f3d84f9df70b8, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.311992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffc3ce-e08d-426f-b914-3920b1ffbead admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.332181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 805/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:36 2022] PUT /identity/v3/projects/8f184693bc4049f0b6767ae7361cac20/users/4345d08b42bf4097bf8f3d84f9df70b8/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:36.333244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 801/1606] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:36 2022] PUT /identity/v3/projects/b5209c2872554c80b1fc770f46d4dda8/users/0690e45336654d62839d7bfdf779a577/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:36.333743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea93-624d-44d2-90ff-b6e5603f7124 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.334359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea93-624d-44d2-90ff-b6e5603f7124 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.334861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea93-624d-44d2-90ff-b6e5603f7124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.336946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.339594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.340134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.373407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e445ea93-624d-44d2-90ff-b6e5603f7124 None None] MFA Rules not processed for user `72f6f036211a4cc9aa78ae4936b5b5be`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.376340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e445ea93-624d-44d2-90ff-b6e5603f7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.401601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.403081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.500939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 806/1607] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:36.503256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:36.506266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664ed2-b823-47a5-8c32-8213be85f241 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.506778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664ed2-b823-47a5-8c32-8213be85f241 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.507209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c664ed2-b823-47a5-8c32-8213be85f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.520633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 802/1608] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:36.521710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.541321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221d78-0cea-40f5-990b-1c077107fb76 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.547655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.552466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7c664ed2-b823-47a5-8c32-8213be85f241 None None] MFA Rules not processed for user `b14d87e680334ea289b5a21c5b67d428`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.555119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7c664ed2-b823-47a5-8c32-8213be85f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.555469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.555887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.556928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] PATH_INFO: `/v3/projects/5ab3561c09eb4efab2af9b1a305cca2b/users/8bca805646ef4a86ad9ca78f6e27ca50/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.575983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab3561c09eb4efab2af9b1a305cca2b, user_id=8bca805646ef4a86ad9ca78f6e27ca50, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.583313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8414e87-1f44-4763-96b6-a5f0e0465d01 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.610211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 803/1609] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:36 2022] PUT /identity/v3/projects/5ab3561c09eb4efab2af9b1a305cca2b/users/8bca805646ef4a86ad9ca78f6e27ca50/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:36.613042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.613042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.613042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.652475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.654150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.670976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 807/1610] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:36.677891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.678183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.678803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.686811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:36.771441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] MFA Rules not processed for user `4345d08b42bf4097bf8f3d84f9df70b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.773141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.809378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 804/1611] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:36.810299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.822276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922666-0d09-41c9-bb86-d26beccfdf04 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.827491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:36.828202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.828501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.828882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.829650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:36.832066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca324c-d65a-401b-84e6-e7a32f7510ab admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:36.855728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 808/1612] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:36.860266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:36.873766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 805/1613] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:36.876197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58828c-072d-46b5-a9e8-c47b5b7b2b27 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:36.877230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58828c-072d-46b5-a9e8-c47b5b7b2b27 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:36.877428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58828c-072d-46b5-a9e8-c47b5b7b2b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:36.920198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8a58828c-072d-46b5-a9e8-c47b5b7b2b27 None None] MFA Rules not processed for user `8bca805646ef4a86ad9ca78f6e27ca50`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:36.921663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8a58828c-072d-46b5-a9e8-c47b5b7b2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:36.939645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f79a-d182-4c92-b6be-08b2b0bae233 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:36.999683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.002335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 806/1614] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:37.003895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.004285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.004676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.006317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.006618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.006896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.012037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 807/1615] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 22 06:05:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:05:37.013010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.015018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:37.043017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85723a47-3035-4274-9e26-a24e7f2863a2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.048567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.049230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.049523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.049807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.080540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.082278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.089087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:37.100166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 809/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:37.100867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.110518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:37.111699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf2392-1e29-4d65-9b64-87b6b9e79a8f service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.119151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.120431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.120431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.120992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.121885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.124417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.150733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.152725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.169685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 808/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:37.170623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.186546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 810/1618] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:37.189725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.189852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a626844-e626-4dfe-8a53-b38dd2fb0b6f service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.285217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a893-6a38-48e0-b064-787034fdfd5a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.292458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.293564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.293896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.294729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.295547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.298914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069d21-8833-450a-8c86-c92ba0f61010 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.316900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.317702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.318055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.318404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.319173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.322615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.347479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 811/1619] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:37.351083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.351496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.354220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.367653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 809/1620] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:37.368363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.392389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:37.393636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:37.397160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed164ed-efcb-43a8-b2d4-ba209594b83e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.539974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.540673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.540948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.541230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.542520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.542647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 812/1621] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:37.543383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.552585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.565456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c440b73-bb1b-49df-999b-3174952d1e6d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.575411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.576071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.576358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.576633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.577338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.579291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.588111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 810/1622] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/users => generated 309 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:37.589312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.608006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5aa8-9244-4278-9fda-1e698ed1adfb admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.614839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.615685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.615972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.616251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.618107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.620611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.632113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 813/1623] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:37 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:37.633293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.655931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f8536-0a2f-4f03-aa25-38f48c04ff21 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.663536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 811/1624] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:37.667767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.670289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.671017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.672453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.672800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.691747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e978-87f9-4ee6-b311-acf492937243 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.706254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.706945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.707232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.707542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.708313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.710035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.734139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 812/1625] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:37.735101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.758556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:37.762802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd494da-c763-4f70-bf88-4d11222eab20 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.780193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.781189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.781189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.781456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.782169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.784151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.799787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.801673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.818305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 813/1626] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:37.822260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.828639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 814/1627] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:37.829473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.843424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19914f5-3323-4643-aa00-76e64ab15d35 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.849537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.850192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4623-842a-45f6-b0dc-6521de18b837 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:37.851975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.852411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.853069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] PATH_INFO: `/v3/projects/04218dbb976d41b09469de5f9f7e876b/users/8e191b83180743aebc475e159a46a44e/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.860399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:37.861296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:37.861575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:37.861849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] PATH_INFO: `/v3/projects/dc03db0311064a21912dcd72d4f50972/users/fbb6080fdff9499c994212eed5e924e8/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:37.877765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=04218dbb976d41b09469de5f9f7e876b, user_id=8e191b83180743aebc475e159a46a44e, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.880880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.884165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:37.891532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc03db0311064a21912dcd72d4f50972, user_id=fbb6080fdff9499c994212eed5e924e8, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:37.894228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:37.925976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 815/1629] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:37 2022] PUT /identity/v3/projects/dc03db0311064a21912dcd72d4f50972/users/fbb6080fdff9499c994212eed5e924e8/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:37.926621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:37.926976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 814/1629] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:37 2022] PUT /identity/v3/projects/04218dbb976d41b09469de5f9f7e876b/users/8e191b83180743aebc475e159a46a44e/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:37.933531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.022051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46d16a-82dd-4728-ad52-6ee6aa3285fc admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.174325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a7301-b36c-4acf-8346-a75fba5df402 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.174325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.174325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.174325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.176477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] PATH_INFO: `/v3/projects/1d2963e3c5774b08af2866872ccc4121/users/766f7d05898a4a26a95f1d65dae146fb/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.176743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.176743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.176743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.176743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.178546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.180508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2963e3c5774b08af2866872ccc4121, user_id=766f7d05898a4a26a95f1d65dae146fb, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.188491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.191652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.225567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 816/1630] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:37 2022] PUT /identity/v3/projects/1d2963e3c5774b08af2866872ccc4121/users/766f7d05898a4a26a95f1d65dae146fb/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:38.226178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.235113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 815/1631] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:38.238420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.263142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1a59-1b75-41b7-9bff-2b359bceffc5 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.376841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694919-cb7c-44f8-bc13-377159a2afb8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.389583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.390451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.390774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.392201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.393296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.393685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.394478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.394769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.395060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.395835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affbc76-5724-46de-a86e-dbe326028a61 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.398867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.402790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.417135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 817/1632] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:38.418100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.427617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 816/1633] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:38.431546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8d65-3272-437a-a2d0-c28624c27c46 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.431856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8d65-3272-437a-a2d0-c28624c27c46 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.432165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61fce0-b32d-4fae-9a3e-088d5644020a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.432294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8d65-3272-437a-a2d0-c28624c27c46 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.435411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 817/1634] 10.222.0.13 () {54 vars in 961 bytes} [Wed Jun 22 06:05:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:05:38.438482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8d65-3272-437a-a2d0-c28624c27c46 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.438690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.440053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.440182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.440551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] PATH_INFO: `/v3/projects/04218dbb976d41b09469de5f9f7e876b/users/8e191b83180743aebc475e159a46a44e/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.443769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04218dbb976d41b09469de5f9f7e876b, user_id=8e191b83180743aebc475e159a46a44e, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.447028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.453560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8d65-3272-437a-a2d0-c28624c27c46 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.459763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 818/1635] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:38 2022] PUT /identity/v3/projects/04218dbb976d41b09469de5f9f7e876b/users/8e191b83180743aebc475e159a46a44e/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:38.461563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:38.499390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:38.511062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:38.552691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.554082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.554844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.563028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] PATH_INFO: `/v3/projects/dc03db0311064a21912dcd72d4f50972/users/fbb6080fdff9499c994212eed5e924e8/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.567150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc03db0311064a21912dcd72d4f50972, user_id=fbb6080fdff9499c994212eed5e924e8, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.572989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef42ce-1c16-4074-be49-df2cf04e3ab0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.601220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 818/1636] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:38 2022] PUT /identity/v3/projects/dc03db0311064a21912dcd72d4f50972/users/fbb6080fdff9499c994212eed5e924e8/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:38.601220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6665646-2679-4bd6-8753-0e2cea89b393 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.601220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6665646-2679-4bd6-8753-0e2cea89b393 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.601220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6665646-2679-4bd6-8753-0e2cea89b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.601929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16e50-91ad-4ddc-bd1b-de629079f103 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:38.651042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b6665646-2679-4bd6-8753-0e2cea89b393 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:38.652548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b6665646-2679-4bd6-8753-0e2cea89b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:38.727965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:38.729098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.729708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.730372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] PATH_INFO: `/v3/projects/1d2963e3c5774b08af2866872ccc4121/users/766f7d05898a4a26a95f1d65dae146fb/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.734504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2963e3c5774b08af2866872ccc4121, user_id=766f7d05898a4a26a95f1d65dae146fb, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:38.753769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de460fa0-657c-425e-9ea6-1df616d30a92 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:38.792141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 819/1637] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:38 2022] PUT /identity/v3/projects/1d2963e3c5774b08af2866872ccc4121/users/766f7d05898a4a26a95f1d65dae146fb/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:38.794202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8295b-2c1a-4666-bc89-b27f9f9a0317 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.794496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8295b-2c1a-4666-bc89-b27f9f9a0317 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.796038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8295b-2c1a-4666-bc89-b27f9f9a0317 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.803437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 820/1638] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 22 06:05:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:05:38.805530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106191fe-e052-4086-abf1-193b66fe7731 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.806459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106191fe-e052-4086-abf1-193b66fe7731 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.806753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106191fe-e052-4086-abf1-193b66fe7731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.823975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 819/1639] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Jun 22 06:05:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:38.825547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c305c-1d82-45d8-8a73-0fc486e5dc02 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:38.825840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c305c-1d82-45d8-8a73-0fc486e5dc02 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:38.826172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c305c-1d82-45d8-8a73-0fc486e5dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:38.876750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-401c305c-1d82-45d8-8a73-0fc486e5dc02 None None] MFA Rules not processed for user `fbb6080fdff9499c994212eed5e924e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:38.878209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-401c305c-1d82-45d8-8a73-0fc486e5dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:38.886692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-106191fe-e052-4086-abf1-193b66fe7731 None None] MFA Rules not processed for user `8e191b83180743aebc475e159a46a44e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:38.890943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-106191fe-e052-4086-abf1-193b66fe7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:39.018863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 820/1640] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:39.018863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa700e-c1dc-461a-9ae9-e7da832e34b8 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.018863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa700e-c1dc-461a-9ae9-e7da832e34b8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.019761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa700e-c1dc-461a-9ae9-e7da832e34b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.074243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 821/1641] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:39.074671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.077617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.079381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.093091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5daa700e-c1dc-461a-9ae9-e7da832e34b8 None None] MFA Rules not processed for user `766f7d05898a4a26a95f1d65dae146fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:39.097202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5daa700e-c1dc-461a-9ae9-e7da832e34b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:39.128600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:39.132166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:39.173678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:39.232722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:39.263634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 821/1642] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:39.265303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795578-c87c-4d35-98a7-ee7346d3c3aa None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.265826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795578-c87c-4d35-98a7-ee7346d3c3aa None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.266433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795578-c87c-4d35-98a7-ee7346d3c3aa None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.272711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 822/1643] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 22 06:05:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:05:39.273976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795578-c87c-4d35-98a7-ee7346d3c3aa None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:39.297448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 822/1644] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:39.298904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:39.393402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795578-c87c-4d35-98a7-ee7346d3c3aa None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:39.402748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25651599-e8b3-487e-98a4-7a90aa32f0b9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:39.404226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:39.405158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.405452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.405836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.415892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:39.416756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.417133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.417537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.428609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:39.432491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534f2c7-fd81-4be4-a7f9-dc2cdd2d3d17 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:39.443898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:39.446484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:39.452324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 823/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:39.469458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.469873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.470157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.485649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 823/1646] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:39.495257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:39.499841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:39.531460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 824/1647] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:39.578263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:39.581108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:39.593059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9463-8ac3-4f80-a750-98bf5654220d service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:39.599413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dea64-de8c-4e0d-a707-82ddcb30c5a7 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:39.604194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:39.604730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:39.605386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.605628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.605745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.605927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.606413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.606896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.620084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:39.621527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:39.633244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:39.635246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:39.646398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 825/1648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:39.658092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 824/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:39.712946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:39.722652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0993e-9b32-42ea-bfe5-31ce3b08aa37 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:39.727427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:39.728106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:39.728436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:39.728719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:39.743652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:39.745496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8132cea-ab0c-4316-b4ea-1dacd0105f78 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:39.758433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 826/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:40.829723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:41.075353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931224e-6ec6-460d-8490-d52d5f3e3640 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:41.098403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:41.099311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:41.099693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:41.099972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] PATH_INFO: `/v3/users/4345d08b42bf4097bf8f3d84f9df70b8` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:41.104700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4345d08b42bf4097bf8f3d84f9df70b8)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:41.105751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: WARNING py.warnings [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:41.105751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: warnings.warn(msg) Jun 22 06:05:41.105751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: Jun 22 06:05:41.107178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:41.263550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4345d08b42bf4097bf8f3d84f9df70b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:41.264498 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4345d08b42bf4097bf8f3d84f9df70b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:41.265599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4345d08b42bf4097bf8f3d84f9df70b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:41.290191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4345d08b42bf4097bf8f3d84f9df70b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:41.330963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:41.339185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4345d08b42bf4097bf8f3d84f9df70b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:41.375597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 825/1651] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:40 2022] DELETE /identity/v3/users/4345d08b42bf4097bf8f3d84f9df70b8 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:41.390943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:41.393517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:41.396059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:41.450913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:41.453063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:41.607872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 827/1652] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:41.629362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:41.630615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:41.831741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba410-c5a0-4732-aaca-d834a0593620 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:41.842537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:41.843614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:41.843718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:41.844008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:41.868765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:41.870591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b5a7e-0280-492b-8033-188ab915ba43 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:41.897778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 826/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:42.132733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:42.134289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:42.204117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac14ab-95a6-4abd-88e3-f059a7623f13 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:42.236366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:42.239792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:42.240125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:42.240507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] PATH_INFO: `/v3/users/72f6f036211a4cc9aa78ae4936b5b5be` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:42.243180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f6f036211a4cc9aa78ae4936b5b5be)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:42.246960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:42.404081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:42.411531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f6f036211a4cc9aa78ae4936b5b5be'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:42.451257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f6f036211a4cc9aa78ae4936b5b5be'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:42.454573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f6f036211a4cc9aa78ae4936b5b5be'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:42.457044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f6f036211a4cc9aa78ae4936b5b5be'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:42.490717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f6f036211a4cc9aa78ae4936b5b5be'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:42.537855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 828/1654] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:42 2022] DELETE /identity/v3/users/72f6f036211a4cc9aa78ae4936b5b5be => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:42.540060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:42.540248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:42.540534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:42.575896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:42.577443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:42.754352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 827/1655] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:42.792065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:42.793840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:42.969983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a117397-1608-4e98-a7b6-fe9f7b6977ba admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:42.995158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:42.996078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:42.996367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:42.996724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:43.030476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:43.032571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:43.077056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 829/1656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:43.500332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:43.503253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:43.531642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c60ffa-0f96-4dc5-967c-b0cf8f1e3ebe None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:43.564975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:43.569491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:43.571175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:43.571472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] PATH_INFO: `/v3/projects/8f184693bc4049f0b6767ae7361cac20` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:43.577691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f184693bc4049f0b6767ae7361cac20)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:43.583518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:43.685311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f184693bc4049f0b6767ae7361cac20', 'request_id': 'req-a7732559-85ba-4b8a-a6a2-e1171f55550e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:43.697996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f184693bc4049f0b6767ae7361cac20', 'request_id': 'req-a7732559-85ba-4b8a-a6a2-e1171f55550e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:43.706062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f184693bc4049f0b6767ae7361cac20', 'request_id': 'req-a7732559-85ba-4b8a-a6a2-e1171f55550e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:43.720936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] The token cache is being invalidate because project 8f184693bc4049f0b6767ae7361cac20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:43.721311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:43.722307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7732559-85ba-4b8a-a6a2-e1171f55550e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:43.724738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 828/1657] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:43 2022] DELETE /identity/v3/projects/8f184693bc4049f0b6767ae7361cac20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:43.729470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:43.749621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2840-83a7-476b-92ed-3e5d3902c15a service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:43.887163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:43.889555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:43.890088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:43.890537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] PATH_INFO: `/v3/users/fbb6080fdff9499c994212eed5e924e8` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:43.892563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb6080fdff9499c994212eed5e924e8)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:43.895048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:44.012345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb6080fdff9499c994212eed5e924e8'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:44.039680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:44.065152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb6080fdff9499c994212eed5e924e8'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:44.067455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb6080fdff9499c994212eed5e924e8'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:44.068773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb6080fdff9499c994212eed5e924e8'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:44.103143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb6080fdff9499c994212eed5e924e8'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:44.139769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 830/1658] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:43 2022] DELETE /identity/v3/users/fbb6080fdff9499c994212eed5e924e8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:44.814659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d752-dd24-46c6-8b37-dac130495fea None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:44.815533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d752-dd24-46c6-8b37-dac130495fea None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:44.815960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d752-dd24-46c6-8b37-dac130495fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:44.869186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:44.897457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ea84d752-dd24-46c6-8b37-dac130495fea None None] MFA Rules not processed for user `dde622e34c10487a8e7cc1be4a9eef1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:44.901662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ea84d752-dd24-46c6-8b37-dac130495fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.097055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:45.099093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.156171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 829/1659] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:45.160107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.162608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.162902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.228387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] MFA Rules not processed for user `dde622e34c10487a8e7cc1be4a9eef1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:45.229629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.270666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 830/1660] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:45.282413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:45.285353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.318367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d8fb-234b-47ec-a3a1-09a290b088cf admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:45.333688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:45.334766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.336799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.337162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] PATH_INFO: `/v3/users/8bca805646ef4a86ad9ca78f6e27ca50` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.339412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bca805646ef4a86ad9ca78f6e27ca50)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:45.343605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:45.491234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bca805646ef4a86ad9ca78f6e27ca50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.517348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bca805646ef4a86ad9ca78f6e27ca50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.517348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bca805646ef4a86ad9ca78f6e27ca50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.517348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bca805646ef4a86ad9ca78f6e27ca50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.521235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785e3ba-4555-4667-b51d-19a6d6750882 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:45.526693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bca805646ef4a86ad9ca78f6e27ca50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.536497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:45.537929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.542086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.542086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.551183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.578403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:45.580344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:45.589849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 831/1661] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:45 2022] DELETE /identity/v3/users/8bca805646ef4a86ad9ca78f6e27ca50 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:45.592888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:45.594346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 831/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:05:45.595894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:45.598007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.600142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.617710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3c332-31bf-4e2c-a894-fd8ab28e5ff0 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:45.701179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:45.718404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3f71-1f23-4592-9abd-e8e49e860f31 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:45.726964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:45.732632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.733576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.734001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] PATH_INFO: `/v3/projects/54589722a94841bba9e3b257c63b956e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.736595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54589722a94841bba9e3b257c63b956e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:45.737904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: WARNING py.warnings [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 06:05:45.737904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: warnings.warn(msg) Jun 22 06:05:45.737904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: Jun 22 06:05:45.740277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:45.778423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:45.780034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.782329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.783084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] PATH_INFO: `/v3/projects/dc03db0311064a21912dcd72d4f50972` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.787657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc03db0311064a21912dcd72d4f50972)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:45.796111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:45.840185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54589722a94841bba9e3b257c63b956e', 'request_id': 'req-adb065a7-3a75-4ea9-9286-4546e285de95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.857457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54589722a94841bba9e3b257c63b956e', 'request_id': 'req-adb065a7-3a75-4ea9-9286-4546e285de95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.867888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54589722a94841bba9e3b257c63b956e', 'request_id': 'req-adb065a7-3a75-4ea9-9286-4546e285de95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.882828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:45.894793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] The token cache is being invalidate because project 54589722a94841bba9e3b257c63b956e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:45.895212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.896438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-adb065a7-3a75-4ea9-9286-4546e285de95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.902989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 832/1663] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:45 2022] DELETE /identity/v3/projects/54589722a94841bba9e3b257c63b956e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:45.902989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743de5-65c9-4069-ac6f-5ca43e2566b8 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:45.902989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743de5-65c9-4069-ac6f-5ca43e2566b8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:45.902989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743de5-65c9-4069-ac6f-5ca43e2566b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:45.940782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc03db0311064a21912dcd72d4f50972', 'request_id': 'req-775ce021-6fbf-4866-b2c1-94c09eb329d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.947968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-61743de5-65c9-4069-ac6f-5ca43e2566b8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:45.949939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-61743de5-65c9-4069-ac6f-5ca43e2566b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:45.961253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc03db0311064a21912dcd72d4f50972', 'request_id': 'req-775ce021-6fbf-4866-b2c1-94c09eb329d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:45.985604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc03db0311064a21912dcd72d4f50972', 'request_id': 'req-775ce021-6fbf-4866-b2c1-94c09eb329d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.005648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] The token cache is being invalidate because project dc03db0311064a21912dcd72d4f50972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:46.006008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.006709 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.034354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 832/1664] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:45 2022] DELETE /identity/v3/projects/dc03db0311064a21912dcd72d4f50972 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:46.036326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.040297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.083737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 833/1665] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:46.085200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac342b-c57d-43c3-a914-3af3d19aaefb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.085511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac342b-c57d-43c3-a914-3af3d19aaefb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.086044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac342b-c57d-43c3-a914-3af3d19aaefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.124344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-1cac342b-c57d-43c3-a914-3af3d19aaefb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:46.126257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1cac342b-c57d-43c3-a914-3af3d19aaefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.150447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 834/1666] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:46.161036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.161194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.161504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.211897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:46.214402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.244995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 835/1667] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:46.244995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.244995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.269591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce021-6fbf-4866-b2c1-94c09eb329d1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:46.282994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:46.285736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.285995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.286283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] PATH_INFO: `/v3/users/8e191b83180743aebc475e159a46a44e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.292177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e191b83180743aebc475e159a46a44e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:46.294168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:46.365056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f008fb-729b-464c-bf4c-e5c4a83edb58 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:46.370331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:46.371214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.371516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.371869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.408080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:46.412370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:46.415617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e191b83180743aebc475e159a46a44e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.417309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e191b83180743aebc475e159a46a44e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.418379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e191b83180743aebc475e159a46a44e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.434465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e191b83180743aebc475e159a46a44e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.446223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 836/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:46.447402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.461608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a90de88c-61f8-45cd-ab4c-8f48eec56d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e191b83180743aebc475e159a46a44e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:46.464469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bd49-7736-4f50-9149-ed0817d09144 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:46.478486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:46.480865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.481617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.482175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.483046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:46.483717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:46.485824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:46.489104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 833/1669] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:46 2022] DELETE /identity/v3/users/8e191b83180743aebc475e159a46a44e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:46.491268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdb78-57dc-4d39-863a-91e57d555069 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.497953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdb78-57dc-4d39-863a-91e57d555069 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.498372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdb78-57dc-4d39-863a-91e57d555069 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.504876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 834/1670] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 22 06:05:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:05:46.506135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:46.506241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.506497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.506780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.517531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 837/1671] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:46.519708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.524010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.560487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89b24-4eaa-47c5-8595-93a514e6c499 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:46.627343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:46.628627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.658149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:46.723084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:46.725111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.725402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.725709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.726422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:46.733501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:46.789810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 835/1672] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:05:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:46.796645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 838/1673] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:46 2022] POST /identity/v3/projects => generated 377 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:46.805691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.839269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25e1b3-a8a1-4a51-911e-e987302929e3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:46.888948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:46.891589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:46.992947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:46.993716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:46.995765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:46.995765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:46.997369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.005339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.073920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78aa28-c4d9-4a4d-9595-0355e1a03daf admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.075948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 836/1674] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:46 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:47.080992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:47.087648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.089923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.090039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.090245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.111819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9595-0104-4aaf-9e7f-5399ec17da57 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.113336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.119074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.126183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.127013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.127305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.128516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.129220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.134974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.141784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 839/1675] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:47.156711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 837/1676] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:47.160767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:47.186878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877cb5-43d1-4641-b98f-ee19bf26f95a service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.198186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.199085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.199439 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.199991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.200929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.204610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb815f-359d-484a-8ff5-01c8050efa88 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.222178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 840/1677] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:47.226405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:47.250945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6c02-c852-4808-9744-f78052bebb63 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.268096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.269113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.269468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.269815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] PATH_INFO: `/v3/projects/5af9282ad3d84609affd2b189a29be87/users/86cd08634e5f4b09b6b647877ff0104e/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.301509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af9282ad3d84609affd2b189a29be87, user_id=86cd08634e5f4b09b6b647877ff0104e, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.306684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.346192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 838/1678] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:47 2022] PUT /identity/v3/projects/5af9282ad3d84609affd2b189a29be87/users/86cd08634e5f4b09b6b647877ff0104e/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:47.356768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.357530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.357892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.411401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] MFA Rules not processed for user `86cd08634e5f4b09b6b647877ff0104e`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:47.413044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:47.582071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 841/1679] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:47.587020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:47.738359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5c8a-bf81-4843-be5b-40e82f1952a8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.746681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.747161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.747534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.747913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.758639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.761590 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:47.812867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 839/1680] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:47 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:47.812971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:47.843744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2d1c6-3a47-4508-bf34-3fef6449fd69 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:47.861790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:47.987389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:47.987830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:47.988114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:47.988504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:47.989360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:47.993820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.054166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 842/1681] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:47 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:48.055959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.066588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:48.073416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc427e-bb3d-4c2c-b569-f534f603bb4c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:48.083278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:48.084146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.086356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.086744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.088700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:48.091566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.113068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 840/1682] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:48.115494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.134415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3362a16-e019-407b-bfa0-df016a6b57a5 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:48.141613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:48.144555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.144555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.144555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] PATH_INFO: `/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78/users/edce3f3fdb80418ba0b83ba931f93222/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.231399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd8b9ec07584118bb2d8c8eeaf17a78, user_id=edce3f3fdb80418ba0b83ba931f93222, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:48.252876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.294688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 843/1683] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:48 2022] PUT /identity/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78/users/edce3f3fdb80418ba0b83ba931f93222/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:48.295851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.307911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5308b6-af1b-44f3-a201-0eed806c6a94 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:48.342013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.345030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:48.477948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:48.481685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.491061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.496390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.497252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:48.502523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.511749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8742-48b5-40f6-982f-2e9e1b8b83d0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:48.524210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:48.525108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.525397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.525672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] PATH_INFO: `/v3/projects/5ab3561c09eb4efab2af9b1a305cca2b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.527207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab3561c09eb4efab2af9b1a305cca2b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:48.529200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.549587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 841/1684] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:48.552664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.577105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622901bc-e62f-4866-b6b2-6f9826c6e735 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:48.582788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:48.583735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.584141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.584427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] PATH_INFO: `/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78/users/edce3f3fdb80418ba0b83ba931f93222/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.586879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd8b9ec07584118bb2d8c8eeaf17a78, user_id=edce3f3fdb80418ba0b83ba931f93222, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:48.589902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657ddec-fc74-4153-8467-d4cebf717da9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:48.606320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 842/1685] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:48 2022] PUT /identity/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78/users/edce3f3fdb80418ba0b83ba931f93222/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:48.608433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a89b-748a-4392-a261-a6e776c89ab5 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.608716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a89b-748a-4392-a261-a6e776c89ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.609367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a89b-748a-4392-a261-a6e776c89ab5 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.611761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 843/1686] 10.222.0.13 () {54 vars in 960 bytes} [Wed Jun 22 06:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 06:05:48.617515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.617809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.618092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.647988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab3561c09eb4efab2af9b1a305cca2b', 'request_id': 'req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:48.659933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] MFA Rules not processed for user `edce3f3fdb80418ba0b83ba931f93222`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:48.661543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:48.667609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab3561c09eb4efab2af9b1a305cca2b', 'request_id': 'req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:48.683430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab3561c09eb4efab2af9b1a305cca2b', 'request_id': 'req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:48.706613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] The token cache is being invalidate because project 5ab3561c09eb4efab2af9b1a305cca2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:48.706946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:48.716059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db2f8723-fcfc-495a-8879-8d9ddaa4f38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:48.718152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 844/1687] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:48 2022] DELETE /identity/v3/projects/5ab3561c09eb4efab2af9b1a305cca2b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:05:48.719491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:48.719810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:48.720093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:48.735013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:48.755845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:48.758089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:48.840732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 844/1688] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:05:48.841766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.852458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:48.910175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 845/1689] 10.222.0.13 () {58 vars in 1057 bytes} [Wed Jun 22 06:05:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:48.911271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:48.915449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:48.993628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab0693-3d28-4199-b1ee-04d5c85a3104 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.004100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.005051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.005391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.005694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] PATH_INFO: `/v3/users/766f7d05898a4a26a95f1d65dae146fb` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.008191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766f7d05898a4a26a95f1d65dae146fb)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.010192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.015906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:49.108289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828ed5-51a7-4f8c-8b80-b31d0e3b250b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.109043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766f7d05898a4a26a95f1d65dae146fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.110257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766f7d05898a4a26a95f1d65dae146fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.111831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766f7d05898a4a26a95f1d65dae146fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.122960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.123857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.124437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.124623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766f7d05898a4a26a95f1d65dae146fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.124716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] PATH_INFO: `/v3/projects/04218dbb976d41b09469de5f9f7e876b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.128057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04218dbb976d41b09469de5f9f7e876b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.130048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.154648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766f7d05898a4a26a95f1d65dae146fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.182398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 845/1690] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:48 2022] DELETE /identity/v3/users/766f7d05898a4a26a95f1d65dae146fb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:49.183688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:49.188066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.241580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04218dbb976d41b09469de5f9f7e876b', 'request_id': 'req-b6bfe088-6e0f-415e-a403-549573709c4f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.280620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04218dbb976d41b09469de5f9f7e876b', 'request_id': 'req-b6bfe088-6e0f-415e-a403-549573709c4f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.295447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04218dbb976d41b09469de5f9f7e876b', 'request_id': 'req-b6bfe088-6e0f-415e-a403-549573709c4f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.320451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] The token cache is being invalidate because project 04218dbb976d41b09469de5f9f7e876b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:49.320608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.322614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:49.342271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 846/1691] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:48 2022] DELETE /identity/v3/projects/04218dbb976d41b09469de5f9f7e876b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:49.343297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:49.349125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.370854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0652-e7e8-424a-8db4-77e6eef12473 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.472978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:49.536885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.540821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.541560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.541850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.554274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.613164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe088-6e0f-415e-a403-549573709c4f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.628581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.629540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.629965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.630382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.633459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.650647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.653129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df0119-26e9-46a7-917b-b4d0d903589a service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.675263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 847/1692] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:49.677063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8a8d-1831-4941-b369-64a39f935e69 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.677557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8a8d-1831-4941-b369-64a39f935e69 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.677982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8a8d-1831-4941-b369-64a39f935e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.711668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ae4c8a8d-1831-4941-b369-64a39f935e69 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:49.713220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ae4c8a8d-1831-4941-b369-64a39f935e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.735140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:49.769500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.770569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.807841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 846/1693] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:49.809951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:49.816198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.841778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 848/1694] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:49.843308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.843849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.844149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.882830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:49.883172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72a37-80c0-476e-8120-9aa0f4c5eb22 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.888233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:49.900577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.903705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.905188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.905495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] PATH_INFO: `/v3/users/b14d87e680334ea289b5a21c5b67d428` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.910296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14d87e680334ea289b5a21c5b67d428)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.913792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 849/1695] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:05:49.913896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.914637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:49.937116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce5704-b879-4616-afc9-8345b5f038d3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:49.948817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:49.950798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:49.951092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:49.952550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:49.953323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:49.955883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:49.958219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:49.975663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 850/1696] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:05:49.979666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:50.001142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca81fd-6bd4-4210-b69c-7bd68f864d7f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:50.008334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14d87e680334ea289b5a21c5b67d428'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.010345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14d87e680334ea289b5a21c5b67d428'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.012200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14d87e680334ea289b5a21c5b67d428'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.021474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:50.022105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.022544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.025128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.026106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:50.028196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408927-5d69-4396-b8e3-4c4e481b3d45 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:50.037738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14d87e680334ea289b5a21c5b67d428'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.071179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e155de9-c825-40a9-8140-1e7c62b040ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14d87e680334ea289b5a21c5b67d428'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.105580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 847/1697] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:49 2022] DELETE /identity/v3/users/b14d87e680334ea289b5a21c5b67d428 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:50.110410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.111039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.111317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.134244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 851/1698] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:49 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:50.140987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.141443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.142750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.215311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] MFA Rules not processed for user `0690e45336654d62839d7bfdf779a577`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:50.217390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.217740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:50.218939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.371748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 852/1699] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:50.374388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:50.376522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.404542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 848/1700] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:50.404542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:50.412074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.415875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552676b-b02a-4c2f-8a86-40907521691a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:50.433828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:50.438760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.439053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.439337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] PATH_INFO: `/v3/users/e49aee17a817492980a15f564b74da67` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.445597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49aee17a817492980a15f564b74da67)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:50.447687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:50.461541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd5ea8-5fde-4658-9fce-800d10b69308 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:50.481452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:50.482079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.482373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.482641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.483783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:50.487945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:50.495991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:50.553218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 849/1701] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:50 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:50.554932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:50.568508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.609572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49aee17a817492980a15f564b74da67'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.661138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49aee17a817492980a15f564b74da67'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.664002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49aee17a817492980a15f564b74da67'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.674093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49aee17a817492980a15f564b74da67'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.705731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49aee17a817492980a15f564b74da67'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:50.732072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:50.740536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 853/1702] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:50 2022] DELETE /identity/v3/users/e49aee17a817492980a15f564b74da67 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:50.744747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:50.765633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.787155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ad2c5-8822-4aa3-af7d-f55bb50a5634 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:50.912829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:50.914118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:50.914406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:50.914681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:50.920465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:50.988729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ddd9c-cb35-49ad-a8d6-acae92bbbf32 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:51.006467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:51.011807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.012146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.012430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.015242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.084450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.086749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.139611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.140930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 850/1703] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:51.148285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:51.150000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.152240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.181172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 854/1704] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:51.183240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:51.187066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.192349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c8bb2-a000-4e79-bad7-28347e6a2b69 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:51.223903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:51.224594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.225057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.225835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.228095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.233088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a4a65-af3b-4452-9e8f-e854ec74875f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.246947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3040-5c21-47f6-bff2-283509947726 service nova] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:51.261545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:51.264704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.265011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.276692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] PATH_INFO: `/v3/projects/1d2963e3c5774b08af2866872ccc4121` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.276692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2963e3c5774b08af2866872ccc4121)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.276692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.299207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 851/1705] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:51.306040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2f9e-52b2-4a98-9b00-fbd6978157b4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.306386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2f9e-52b2-4a98-9b00-fbd6978157b4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.306678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2f9e-52b2-4a98-9b00-fbd6978157b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.343680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:51.351363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d7cc2f9e-52b2-4a98-9b00-fbd6978157b4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:51.352908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d7cc2f9e-52b2-4a98-9b00-fbd6978157b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.380024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 852/1706] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:51.383136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.383490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.383794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.419309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2963e3c5774b08af2866872ccc4121', 'request_id': 'req-822172ea-288a-471a-b290-80e40455b49d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:51.443548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2963e3c5774b08af2866872ccc4121', 'request_id': 'req-822172ea-288a-471a-b290-80e40455b49d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:51.451486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] MFA Rules not processed for user `b470e4bbcf67422c860831db2f2d61af`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:51.452746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.487379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2963e3c5774b08af2866872ccc4121', 'request_id': 'req-822172ea-288a-471a-b290-80e40455b49d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:51.528985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] The token cache is being invalidate because project 1d2963e3c5774b08af2866872ccc4121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:51.529424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:51.532193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:51.540834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 855/1707] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:51 2022] DELETE /identity/v3/projects/1d2963e3c5774b08af2866872ccc4121 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:51.540834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:51.548024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.611746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 853/1708] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:51.612659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:51.620560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.666031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:51.790803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f943-fe99-4865-bdd7-f0112ee83502 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:51.822355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:51.824868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.827140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.828329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.838039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.881941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822172ea-288a-471a-b290-80e40455b49d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:51.883252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.887985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1180f-4f5a-4fdc-b27f-62616879230d service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.897631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:51.898289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.898633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.898854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.899673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:51.907695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:51.916074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 854/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:51.919642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:51.919970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:51.921537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:51.943237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 856/1710] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:51.948675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:51.960128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:51.982385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:51.991024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.019950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 855/1711] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:52.022068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.024668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.056423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafef8f-ef65-40fd-9afb-32ef9481488f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.066994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.067907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.068192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.070779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] PATH_INFO: `/v3/projects/34a7e0518c854cb0b70a8eb41935637c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.073388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a7e0518c854cb0b70a8eb41935637c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.079184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.182308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a7e0518c854cb0b70a8eb41935637c', 'request_id': 'req-046be7e6-e851-4045-9463-e8cf8cbb906d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:52.197398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a7e0518c854cb0b70a8eb41935637c', 'request_id': 'req-046be7e6-e851-4045-9463-e8cf8cbb906d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:52.216396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a7e0518c854cb0b70a8eb41935637c', 'request_id': 'req-046be7e6-e851-4045-9463-e8cf8cbb906d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:52.232365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] The token cache is being invalidate because project 34a7e0518c854cb0b70a8eb41935637c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:52.232665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:52.233496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:52.235128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 856/1712] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:52 2022] DELETE /identity/v3/projects/34a7e0518c854cb0b70a8eb41935637c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:52.235892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.237784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.253980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545db84-a6e0-4e04-b74c-469528d41a3d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.365350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:52.412677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be7e6-e851-4045-9463-e8cf8cbb906d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.418840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.419633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.420168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.420275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.420372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.420940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.421224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.421505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] PATH_INFO: `/v3/projects/19fcfd00daf94b7eb45a62262e0d2ac9/users/baf2adfdcc4c4da1b0cdd0257417d1b8/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.422916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.445048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fcfd00daf94b7eb45a62262e0d2ac9, user_id=baf2adfdcc4c4da1b0cdd0257417d1b8, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.447943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5700c9-5494-4497-a475-1d06c4805bcf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.472769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 857/1713] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:52 2022] PUT /identity/v3/projects/19fcfd00daf94b7eb45a62262e0d2ac9/users/baf2adfdcc4c4da1b0cdd0257417d1b8/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:52.476532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf72c6-95b6-4bab-b531-24175ae9bce6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.476881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf72c6-95b6-4bab-b531-24175ae9bce6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.477214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf72c6-95b6-4bab-b531-24175ae9bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.519179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-dddf72c6-95b6-4bab-b531-24175ae9bce6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:52.521463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dddf72c6-95b6-4bab-b531-24175ae9bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.541040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:52.559394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.561739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03426-5fba-4e78-b248-698e1de426f5 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.574422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 857/1714] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:52.575981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.576595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.577118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.620093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:52.622476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.630137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 858/1715] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:52.633135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.633429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.634073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.649890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 858/1716] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:52.651042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.674382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74dc3-2e8d-4d63-b4ed-69d5be6510c6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.683800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] MFA Rules not processed for user `baf2adfdcc4c4da1b0cdd0257417d1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:52.685219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.686861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.688197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.690498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.690931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.693790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:52.694815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.696676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f8554-1ef5-44ef-9d9b-572101279ad5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.730666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 859/1717] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:52.737757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.738323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.738770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.788693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:52.797935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:52.825244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 860/1718] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:52.825244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.837297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44cb09-ae0e-4703-9ebb-2cfef80982b1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.856230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.856903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.857191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.857647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.860310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.862836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 859/1719] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:52.865443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.865560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.912539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c7fce-c9a4-4233-9f17-21f0aa901499 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:52.928340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 861/1720] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:52.929795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:52.937939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:52.948732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:52.950390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:52.951352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:52.952750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:52.953403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:52.968208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:52.989656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 860/1721] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:52.995824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.057395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2e63-df2d-41b4-8dcc-8f25fab1a32a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.145266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70926-ee2c-4728-9941-5e733f1709ea admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.160703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.162027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.164007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.164445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.165346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.168980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.194073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.195152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.196601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.196961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.198949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.205809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.214835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 862/1722] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/projects => generated 389 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:53.216568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.223991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:53.256131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 861/1723] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:52 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:53.257707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.273498 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098816-69e7-4731-badd-3d20906d7e2d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.294929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:53.314153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:53.427224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881769c-5be7-4cd5-908a-6b6fa1523c1e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.437758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.438865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.439243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.439591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] PATH_INFO: `/v3/projects/86b33f680fbf4294898251ada897ad9b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.443169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b33f680fbf4294898251ada897ad9b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.447014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.499723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.500384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.500668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.503754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.507782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.512533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.568215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b33f680fbf4294898251ada897ad9b', 'request_id': 'req-b5106bf2-18c3-4972-95df-c44d06cc4280'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:53.579857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 862/1724] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:53 2022] POST /identity/v3/projects => generated 373 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:53.581009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.583623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b33f680fbf4294898251ada897ad9b', 'request_id': 'req-b5106bf2-18c3-4972-95df-c44d06cc4280'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:53.602398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b33f680fbf4294898251ada897ad9b', 'request_id': 'req-b5106bf2-18c3-4972-95df-c44d06cc4280'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:53.633426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] The token cache is being invalidate because project 86b33f680fbf4294898251ada897ad9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:05:53.633953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:53.638432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:53.641049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 863/1725] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:05:53 2022] DELETE /identity/v3/projects/86b33f680fbf4294898251ada897ad9b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:53.642019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.645685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:53.750676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c4ab-2ab9-4a20-bf4e-654f791fc29d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.765794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.766486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.766762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.767039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.767764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.769988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.778376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106bf2-18c3-4972-95df-c44d06cc4280 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.793989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.795188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.795304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.795579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.796292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.797926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2060b0-7c06-409b-a493-4185af501e3e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.814518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 863/1726] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:53 2022] POST /identity/v3/users => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:53.815434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.820033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:53.829991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 864/1727] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:53.832879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.833171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.833455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.848552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751a1a9-78d6-4387-a356-682751039787 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.873866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.874559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.875828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.876111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.876821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.878780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.891644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:53.892928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:53.911970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 865/1728] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:53.913244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.914793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:53.949346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 864/1729] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:53 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:53.949346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:53.977137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f01d-7dae-4c8c-90ef-07ddc7ecee6b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.986732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.987758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.987888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567cc4-7a23-49a8-a6e1-744e21e08bba admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:53.987999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.987999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.988999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.992982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:53.993830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:53.994553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:53.994843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:53.995119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:53.995930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:53.998392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821e3b-228d-46ff-a382-2b60ada31b23 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.021571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 865/1730] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:54.024394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.024833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.025288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.027140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 866/1731] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:54.028403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.062044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5b2b9-3f07-4e80-9b58-6cdc642fffe9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.070383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:54.075288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:54.080470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.081172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.081463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.081747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.082726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.084383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.097451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 866/1732] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:54.098701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.113320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 867/1733] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:54.114236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.117961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1365017-c080-4ab9-b68c-aafff3bfe533 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.139266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.140212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.140497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.140775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] PATH_INFO: `/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1/users/5d27be7ad1dc4609a3684abedd8bf8ff/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.152283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62a9a9-b175-469e-8805-82e9672344ab admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.157543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.158396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.158683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.159098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] PATH_INFO: `/v3/projects/29b83e363dde4f2c9b777ca45235de6d/users/c561f083621d4e5bb90e71f3f1fe1ac0/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.170976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2dd490da4f4c76aeb12f16441d25f1, user_id=5d27be7ad1dc4609a3684abedd8bf8ff, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.173701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.203346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:54.216617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 867/1734] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:54 2022] PUT /identity/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1/users/5d27be7ad1dc4609a3684abedd8bf8ff/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:54.217934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.226638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b83e363dde4f2c9b777ca45235de6d, user_id=c561f083621d4e5bb90e71f3f1fe1ac0, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.229951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.275629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 868/1735] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:54 2022] PUT /identity/v3/projects/29b83e363dde4f2c9b777ca45235de6d/users/c561f083621d4e5bb90e71f3f1fe1ac0/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:54.276327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.338699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:54.372826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff51e9-5212-4a58-9271-b5019d05cd45 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.443639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702843-50d1-47b5-a1db-55c12983be3e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.473745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.474302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.474482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.474875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.475559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.477190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.493677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.494674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.495120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.495523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.496428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:05:54.496843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.498895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18651001-93f5-4aa5-a37a-b9c98db4c1ec admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.513069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 869/1736] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:54.513069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.537801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5826c46-8c65-4fac-b454-83a7e06316b9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.556299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.556502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 868/1737] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:05:54.556596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.556596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.556596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.556815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.556815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.556948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.557043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.558822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.583915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 870/1738] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:54.585429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.609760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb1ca-4f01-43b7-b0cc-c48b046307e8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.620627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.621540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.621818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.622095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] PATH_INFO: `/v3/projects/1c5d39cae1924bed89d9a058c3e27076/users/f54ba7d61e19418ab75f826e822268d4/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.634510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] MFA Rules not processed for user `c561f083621d4e5bb90e71f3f1fe1ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:54.637572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:54.661094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5d39cae1924bed89d9a058c3e27076, user_id=f54ba7d61e19418ab75f826e822268d4, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.663912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.698722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 871/1739] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:54 2022] PUT /identity/v3/projects/1c5d39cae1924bed89d9a058c3e27076/users/f54ba7d61e19418ab75f826e822268d4/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:54.699609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.820344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 869/1740] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:54.827872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.854701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ef096-68b7-4d80-b59d-960c4c56aab0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.864953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5513-b20e-4fb6-a91b-572404673146 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:54.869209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.870129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.870409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.870718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] PATH_INFO: `/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1/users/5d27be7ad1dc4609a3684abedd8bf8ff/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.876436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2dd490da4f4c76aeb12f16441d25f1, user_id=5d27be7ad1dc4609a3684abedd8bf8ff, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.880589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888d00f-6b9d-43a9-816a-00f58b1183a6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.883854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:54.884193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.884487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.884749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.887663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:54.893404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:54.909372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 870/1741] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:54 2022] PUT /identity/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1/users/5d27be7ad1dc4609a3684abedd8bf8ff/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:54.910460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1f7f-d679-4ac3-99fb-a92a0bb76934 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:54.910751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1f7f-d679-4ac3-99fb-a92a0bb76934 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:54.911026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1f7f-d679-4ac3-99fb-a92a0bb76934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:54.977607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 872/1742] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:54 2022] POST /identity/v3/projects => generated 365 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:54.986820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:54.993842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c51b1f7f-d679-4ac3-99fb-a92a0bb76934 None None] MFA Rules not processed for user `f54ba7d61e19418ab75f826e822268d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:54.995152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c51b1f7f-d679-4ac3-99fb-a92a0bb76934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:55.111942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:55.139230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:55.188312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 871/1743] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:55.193299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:55.195841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:55.196355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:55.229698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddc72-8378-451f-9fe7-35723f04d313 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:55.252677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:55.253397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:55.253683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:55.254828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:55.255590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:55.262544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:55.294296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] MFA Rules not processed for user `5d27be7ad1dc4609a3684abedd8bf8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:55.296784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:55.325822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 873/1744] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:55.330502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:55.529228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 872/1745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:55.530333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:55.534604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:55.584333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d79d02-4d63-4df5-969a-30dd7c1e2a2d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:55.598151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:55.598846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:55.599128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:55.599485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:55.600607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:55.604634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:55.668792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 874/1746] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:55 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:55.670393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:55.705659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08a26-ad72-4cd8-8a38-76ca1e84f108 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:55.725807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:55.727476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:55.727476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:55.727736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:55.728415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:55.735174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:55.791256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfcabb-0dd7-4a28-91f5-b2ec3bd5af52 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:55.797877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 875/1747] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:55 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:55.798896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:55.807013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:55.962992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93187b-2238-4872-8a09-a72d091e4e07 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:55.973133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:55.973805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:55.974091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:55.975190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:55.982513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:56.001851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.005496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.005865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.008287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.020866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:56.120044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:56.159432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.162067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.162596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.164408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.184975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 873/1748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:56.185943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.192339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:56.198997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 876/1749] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:56.199967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.267191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bced-43cf-44c9-b620-b7269d49f090 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.269964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946855b5-23a0-4110-8ea6-419ccc7082e8 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.293586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.294155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.294274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.294559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.294822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.295267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.295338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.295403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.295634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.297250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.329947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 877/1750] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:56.331929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.360210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913224-25a0-4da7-879c-6d133c2a76d8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.374072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.378209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.380721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.381029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.383102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.389139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b1983-3a5b-4574-a341-8f6bec3c7e42 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.425452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 878/1751] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:56.428881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edb0b6-3abe-47e5-9b48-db4d6d9517ba None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.430483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edb0b6-3abe-47e5-9b48-db4d6d9517ba None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.431174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edb0b6-3abe-47e5-9b48-db4d6d9517ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.456667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.458368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.476218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 874/1752] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:56.477392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.492308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a2edb0b6-3abe-47e5-9b48-db4d6d9517ba None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:56.492308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a2edb0b6-3abe-47e5-9b48-db4d6d9517ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:56.563963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f8f32-652b-4ae1-ab43-779112aa01c0 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.587620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.588550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.591221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.593408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.595731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.597541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.648109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 875/1753] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:56.651720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.664564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 879/1754] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:05:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:56.666069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.666364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.666653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.683924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b395d5b-e12e-4a3d-a9f7-5fc5c61fa6f7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.707854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.711137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.711429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.713361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] PATH_INFO: `/v3/projects/753eefac7ea3423fba4b68a59a42c11d/users/3fb1993fbb814ccc82f40f4464f2542c/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:56.742712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] MFA Rules not processed for user `0690e45336654d62839d7bfdf779a577`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:56.744245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:56.777047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753eefac7ea3423fba4b68a59a42c11d, user_id=3fb1993fbb814ccc82f40f4464f2542c, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:56.781207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:56.833286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 876/1755] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:56 2022] PUT /identity/v3/projects/753eefac7ea3423fba4b68a59a42c11d/users/3fb1993fbb814ccc82f40f4464f2542c/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:56.835121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.973535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c568-a45e-40ab-bdad-c2acaafa6e36 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:56.986694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 880/1756] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:56.987767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:56.988034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:56.991804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:56.992766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:56.993299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] PATH_INFO: `/v3/projects/aa0543a9f409480686023b67aa0eab80/users/e0f02869d3a94f7fbc0221b73b8bf2dd/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.006219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64b9dd-fb92-457b-8d8c-3e1b0aabf179 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:57.014081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:57.016867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:57.017029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.017029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.017318 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.018324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.020125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.058132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0543a9f409480686023b67aa0eab80, user_id=e0f02869d3a94f7fbc0221b73b8bf2dd, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.072263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.095044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 881/1757] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:57.096184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:57.125265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 877/1758] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:56 2022] PUT /identity/v3/projects/aa0543a9f409480686023b67aa0eab80/users/e0f02869d3a94f7fbc0221b73b8bf2dd/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:57.125265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:57.131201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8a856-3a18-49f0-b338-4cf522523a65 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:57.274876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8102fa-68ff-4255-b077-fc545107027b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:57.283622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:57.283622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.283622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.283622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] PATH_INFO: `/v3/users/baf2adfdcc4c4da1b0cdd0257417d1b8` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.284165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf2adfdcc4c4da1b0cdd0257417d1b8)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.286756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.325699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:57.328059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.330973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.331392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] PATH_INFO: `/v3/users/f54ba7d61e19418ab75f826e822268d4` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.333038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54ba7d61e19418ab75f826e822268d4)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.338972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.343446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:57.381094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf2adfdcc4c4da1b0cdd0257417d1b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.382494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf2adfdcc4c4da1b0cdd0257417d1b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.383227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf2adfdcc4c4da1b0cdd0257417d1b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.402718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf2adfdcc4c4da1b0cdd0257417d1b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.418843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf2adfdcc4c4da1b0cdd0257417d1b8'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.436987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 878/1759] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:57 2022] DELETE /identity/v3/users/baf2adfdcc4c4da1b0cdd0257417d1b8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:57.440368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:57.442838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:57.452829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54ba7d61e19418ab75f826e822268d4'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.474397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54ba7d61e19418ab75f826e822268d4'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.484570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54ba7d61e19418ab75f826e822268d4'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.485484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54ba7d61e19418ab75f826e822268d4'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.497520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54ba7d61e19418ab75f826e822268d4'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:57.520311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 882/1760] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:57 2022] DELETE /identity/v3/users/f54ba7d61e19418ab75f826e822268d4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:57.521537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:57.524005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:57.557977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5902a-6269-4846-bb3f-f0bfdd016c97 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:57.563747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:57.618079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f8f9-7775-44b0-abda-cef1e4018370 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:57.623422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:57.624566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.625329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.625753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] PATH_INFO: `/v3/projects/753eefac7ea3423fba4b68a59a42c11d/users/3fb1993fbb814ccc82f40f4464f2542c/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.628344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753eefac7ea3423fba4b68a59a42c11d, user_id=3fb1993fbb814ccc82f40f4464f2542c, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.631196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475b74-f6a5-4c5b-8227-3d8568e9b354 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.651638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 883/1761] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:57 2022] PUT /identity/v3/projects/753eefac7ea3423fba4b68a59a42c11d/users/3fb1993fbb814ccc82f40f4464f2542c/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:57.662791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:57.663476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.663784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.664066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.665677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be497-01cf-45ca-aac4-19a17ebb3eda None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.666119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be497-01cf-45ca-aac4-19a17ebb3eda None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.666786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be497-01cf-45ca-aac4-19a17ebb3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.667762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:57.704223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-790be497-01cf-45ca-aac4-19a17ebb3eda None None] MFA Rules not processed for user `e0f02869d3a94f7fbc0221b73b8bf2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:57.705634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-790be497-01cf-45ca-aac4-19a17ebb3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:57.771563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:57.774166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d281e-f1b2-48fc-acff-76e562473efd service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:57.788051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 879/1762] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:05:57.791323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b6a7f-3bae-46d5-b405-0cc8b776f49f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.791796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b6a7f-3bae-46d5-b405-0cc8b776f49f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.792445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b6a7f-3bae-46d5-b405-0cc8b776f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.812106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c75b6a7f-3bae-46d5-b405-0cc8b776f49f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:57.814175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c75b6a7f-3bae-46d5-b405-0cc8b776f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:57.830963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 884/1763] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:57.832486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7bcf-5ebc-4764-98fe-34bb57b45eed None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:57.833000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7bcf-5ebc-4764-98fe-34bb57b45eed None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:57.833347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7bcf-5ebc-4764-98fe-34bb57b45eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:57.854454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:57.872476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-181f7bcf-5ebc-4764-98fe-34bb57b45eed None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:57.875012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-181f7bcf-5ebc-4764-98fe-34bb57b45eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.014854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 885/1764] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:58.016315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.016604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.016884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.056791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 880/1765] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:58.058324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.058724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.059009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.092848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] MFA Rules not processed for user `b470e4bbcf67422c860831db2f2d61af`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:58.093992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] MFA Rules not processed for user `3fb1993fbb814ccc82f40f4464f2542c`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:58.095224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.097702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.228733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:58.251320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 881/1766] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:58.251320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.253252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.288945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 886/1767] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:58.289802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.294368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.302382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c18e-0d4d-47cf-be2f-6cd047fdbbd2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:58.319059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:58.320429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.320429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.320781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.321625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:58.327282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:58.398477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 882/1768] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:05:58 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:58.400103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.406629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.455097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3451d-256f-45a3-b31e-26ea3851c190 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:58.554604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:58.561976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:58.562648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.563017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.563281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.614443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a762d5-4083-4370-9038-4de7402ba676 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:58.618771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:58.619440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.619758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.620041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.773214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:58.774104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:58.775078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:58.776543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:58.795873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 887/1769] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:58.796572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.799431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:58.819929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 883/1770] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:58.820931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.846109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad42bd-832d-4868-bbd7-929060e45896 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:58.860128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:58.860669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.861138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.861833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.864533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:58.869563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:58.922890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 884/1771] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:05:58 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:05:58.926870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:58.947713 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a848e-e914-444b-9a35-525d9951032e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:58.972638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:58.973693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:58.973979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:58.974307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:58.975055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:58.978195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.036697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 885/1772] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:59.037687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:59.042430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304657b8-46ac-43a5-9c22-c4e4149d016e service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.056325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80229fb4-4470-4a07-ac7e-499992a09e03 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.069154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.069154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.070855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.070855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] PATH_INFO: `/v3/projects/b6ebabe634494e648a49b3b0c24883f2/users/298cbe35641840c0bd918d338b07ab43/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.071790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.072710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.076153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.077357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.119150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ebabe634494e648a49b3b0c24883f2, user_id=298cbe35641840c0bd918d338b07ab43, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.128750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.153648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 886/1773] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:59 2022] PUT /identity/v3/projects/b6ebabe634494e648a49b3b0c24883f2/users/298cbe35641840c0bd918d338b07ab43/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:59.157686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:59.277673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:59.321059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f68373-7c35-434f-9b49-33df7380f28d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.329724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.330380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.330666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.333446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.334409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.337704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.356651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 887/1774] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:05:59.357595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:59.378932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e55d9-3a7f-4161-b5f2-c85e50d065ba admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.385393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.388848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.388848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.388848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] PATH_INFO: `/v3/projects/b6ebabe634494e648a49b3b0c24883f2/users/298cbe35641840c0bd918d338b07ab43/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.390893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ebabe634494e648a49b3b0c24883f2, user_id=298cbe35641840c0bd918d338b07ab43, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.393756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea769-e0f9-47dd-9b40-29834b8c9f4f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.406863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 888/1775] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:05:59 2022] PUT /identity/v3/projects/b6ebabe634494e648a49b3b0c24883f2/users/298cbe35641840c0bd918d338b07ab43/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:05:59.419829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.420134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.420410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.427406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.430188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.453529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] MFA Rules not processed for user `298cbe35641840c0bd918d338b07ab43`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:59.455080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:59.470554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 888/1776] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:05:59.509562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:59.524628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a928d9-8e93-4ccf-b024-8f5f0d096588 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.637533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 889/1777] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:05:59.656191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:05:59.661269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:05:59.717312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:05:59.755261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.755261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.755261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.755261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] PATH_INFO: `/v3/users/c561f083621d4e5bb90e71f3f1fe1ac0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.756421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c561f083621d4e5bb90e71f3f1fe1ac0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.758190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.789707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1eed-6ecf-43e8-86d9-3e9e99e22df7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:05:59.798866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:05:59.799970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.800803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.801207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.814933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:05:59.826675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e705ae5-e157-48d0-ba26-0b5f05a41b50 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:05:59.843828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 890/1778] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:05:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:05:59.854421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c561f083621d4e5bb90e71f3f1fe1ac0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:59.868812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c561f083621d4e5bb90e71f3f1fe1ac0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:59.870138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c561f083621d4e5bb90e71f3f1fe1ac0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:59.870888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c561f083621d4e5bb90e71f3f1fe1ac0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:59.884230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c561f083621d4e5bb90e71f3f1fe1ac0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:05:59.919474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 889/1779] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:05:59 2022] DELETE /identity/v3/users/c561f083621d4e5bb90e71f3f1fe1ac0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:05:59.920019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:05:59.920361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:05:59.921356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:05:59.970105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:05:59.971588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.046349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:00.047852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.148197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:00.229607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 891/1780] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:00.260440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:00.260440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.329288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bdc68-44dc-47a4-baeb-f7e2500c54c6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:00.346596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:00.350901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.350901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.350901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] PATH_INFO: `/v3/projects/1c5d39cae1924bed89d9a058c3e27076` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.350901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5d39cae1924bed89d9a058c3e27076)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:00.376414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:00.485397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648865-c9d3-46a7-847e-9ed16de1b847 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:00.494429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:00.495216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.495528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.495946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.525727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5d39cae1924bed89d9a058c3e27076', 'request_id': 'req-d67641b0-696e-4506-8214-bb87dd754b65'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:00.534385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:00.541954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5d39cae1924bed89d9a058c3e27076', 'request_id': 'req-d67641b0-696e-4506-8214-bb87dd754b65'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:00.543097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b09dd-586a-46b7-a040-5846df5729b9 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:00.558684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5d39cae1924bed89d9a058c3e27076', 'request_id': 'req-d67641b0-696e-4506-8214-bb87dd754b65'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:00.565601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:00.570068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 892/1781] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:00.575205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7ae4-7029-492d-b968-7977d90f2d7a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.579094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7ae4-7029-492d-b968-7977d90f2d7a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.581844 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] The token cache is being invalidate because project 1c5d39cae1924bed89d9a058c3e27076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:00.582142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:00.582911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7ae4-7029-492d-b968-7977d90f2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.583684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d67641b0-696e-4506-8214-bb87dd754b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:00.588806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 890/1782] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:00 2022] DELETE /identity/v3/projects/1c5d39cae1924bed89d9a058c3e27076 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:00.590313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5885-19e7-4e69-af51-605c01edf316 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.590630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5885-19e7-4e69-af51-605c01edf316 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.590879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad5885-19e7-4e69-af51-605c01edf316 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.594775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 891/1783] 10.222.0.13 () {54 vars in 912 bytes} [Wed Jun 22 06:06:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:06:00.601957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.602257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.604401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.655267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bc6b7ae4-7029-492d-b968-7977d90f2d7a None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:00.658270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bc6b7ae4-7029-492d-b968-7977d90f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.675669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:00.677604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.802923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 893/1784] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 22 06:06:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:00.805600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.806158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.806447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.862449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 892/1785] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:00.864738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:00.873247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.875191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:00.878143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.907399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 894/1786] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:06:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:00.908392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:00.913138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:00.935896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309b013-5c57-4e8b-93c5-36f4e9fba9ef None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:00.942161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4288a21-55ad-4dc1-a311-0dfc7e24e18c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:00.943679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:00.944984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.945270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.945546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] PATH_INFO: `/v3/projects/19fcfd00daf94b7eb45a62262e0d2ac9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.946739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fcfd00daf94b7eb45a62262e0d2ac9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:00.948923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:00.964436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:00.966401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:00.967015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:00.967615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] PATH_INFO: `/v3/users/e0f02869d3a94f7fbc0221b73b8bf2dd` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:00.972520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f02869d3a94f7fbc0221b73b8bf2dd)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:00.989725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.152867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f02869d3a94f7fbc0221b73b8bf2dd'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.174655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f02869d3a94f7fbc0221b73b8bf2dd'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.175589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f02869d3a94f7fbc0221b73b8bf2dd'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.176502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f02869d3a94f7fbc0221b73b8bf2dd'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.180577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fcfd00daf94b7eb45a62262e0d2ac9', 'request_id': 'req-919bc63f-7a0e-40ee-928f-ffd84569fdaf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.190865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f02869d3a94f7fbc0221b73b8bf2dd'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.232348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fcfd00daf94b7eb45a62262e0d2ac9', 'request_id': 'req-919bc63f-7a0e-40ee-928f-ffd84569fdaf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.266048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fcfd00daf94b7eb45a62262e0d2ac9', 'request_id': 'req-919bc63f-7a0e-40ee-928f-ffd84569fdaf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.271810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 893/1787] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:00 2022] DELETE /identity/v3/users/e0f02869d3a94f7fbc0221b73b8bf2dd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:01.273295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.274860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.302892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] The token cache is being invalidate because project 19fcfd00daf94b7eb45a62262e0d2ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:01.306768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.308240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-919bc63f-7a0e-40ee-928f-ffd84569fdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.323923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 895/1788] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:00 2022] DELETE /identity/v3/projects/19fcfd00daf94b7eb45a62262e0d2ac9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:01.325927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.339793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.339793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.396213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:01.402751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.423642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98f49-d9d6-4b29-bd35-8ecb48a08506 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:01.428702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:01.429426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.429709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.430106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.430356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:01.433106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.447830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:01.448386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.466330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 894/1789] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:01.468814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.470582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.483260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906834-2bff-456b-b5a7-6f5d3be710a0 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:01.487178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:01.487872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.488156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.488483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.491153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.504078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:01.505645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb58a2-ad8f-47c9-9048-a6619185535d service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.510215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:01.519622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 895/1790] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:01.521208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.521572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.522698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.559567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:01.561333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.646838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 896/1791] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:01.648389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.650011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.665459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811e51d-5005-4dbf-b307-9544528d1db1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:01.671747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:01.672974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.673330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.673816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] PATH_INFO: `/v3/users/5d27be7ad1dc4609a3684abedd8bf8ff` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.675386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d27be7ad1dc4609a3684abedd8bf8ff)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:01.677804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.695945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 896/1792] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:01.700100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.727358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f40a3-fffa-4152-88c2-46b424bd2ab1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:01.743871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:01.744886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.745354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.745808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.747110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:01.747622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:01.754234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.785970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 897/1793] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:01.792372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.814211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d27be7ad1dc4609a3684abedd8bf8ff'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.821147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d4325-855f-43a5-a07c-765f301ace45 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:01.841716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:01.842525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:01.842911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:01.843278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:01.844214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:01.846845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:01.873018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d27be7ad1dc4609a3684abedd8bf8ff'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.876857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d27be7ad1dc4609a3684abedd8bf8ff'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.879343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d27be7ad1dc4609a3684abedd8bf8ff'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.912214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d27be7ad1dc4609a3684abedd8bf8ff'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:01.916830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 898/1794] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:01 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:01.926440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.930654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:01.965039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 897/1795] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:01 2022] DELETE /identity/v3/users/5d27be7ad1dc4609a3684abedd8bf8ff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:01.968017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:01.976622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:02.121007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc069-c26c-4442-8820-b28f81376b91 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:02.182927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7ab1-5a21-4341-8e82-bc9eec079914 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:02.194414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:02.195114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.196750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.197320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.199165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:02.201187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:02.261258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:02.279814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 898/1796] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:01 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:02.285252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:02.297551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:02.304543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.304898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.305187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.312458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:02.323079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105f10-2178-479c-88c1-8b9314254e9d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:02.344721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:02.345412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.345698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.345984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.346727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:02.348609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:02.365436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:02.367369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:02.388960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 899/1797] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:02.392164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:02.398270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 899/1798] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:02.422154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba974f-7e95-41d5-a34f-817119618584 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:02.429812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:02.430556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.430738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.431151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.431783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:02.433402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4894ad-e532-40ce-8743-0dd40056f9b0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:02.483446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 900/1799] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:02.486499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:02.501560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834344-0b92-4329-a268-ff71af31f235 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:02.510247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:02.513706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.513995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.514280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] PATH_INFO: `/v3/projects/d99877307e3845668b414648065aaf4e/users/ac52cd9c3d7646f190235358a0f7eadf/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.563835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99877307e3845668b414648065aaf4e, user_id=ac52cd9c3d7646f190235358a0f7eadf, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:02.571848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:02.614419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 900/1800] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:02 2022] PUT /identity/v3/projects/d99877307e3845668b414648065aaf4e/users/ac52cd9c3d7646f190235358a0f7eadf/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:02.617152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:02.617614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:02.618495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:02.710378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] MFA Rules not processed for user `ac52cd9c3d7646f190235358a0f7eadf`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:02.717981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:03.032730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 901/1801] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:03.034838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:03.070792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:03.372737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:03.375635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:03.645690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e944-1757-40aa-acab-969be1d44b4b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:03.655322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6d561-1b0e-41a2-96c2-6271483b413b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:03.682280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:03.683445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:03.683938 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:03.684381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:03.685420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:03.687699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:03.711962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:03.725304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:03.727803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:03.728429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] PATH_INFO: `/v3/projects/29b83e363dde4f2c9b777ca45235de6d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:03.734460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b83e363dde4f2c9b777ca45235de6d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:03.744108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:03.798126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 901/1802] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:03 2022] POST /identity/v3/projects => generated 381 bytes in 764 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:03.805003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:03.809955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:03.924132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b83e363dde4f2c9b777ca45235de6d', 'request_id': 'req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:03.952991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b83e363dde4f2c9b777ca45235de6d', 'request_id': 'req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:03.977909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b83e363dde4f2c9b777ca45235de6d', 'request_id': 'req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.002092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:04.022099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] The token cache is being invalidate because project 29b83e363dde4f2c9b777ca45235de6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:04.025043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.027182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.035811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 902/1803] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:03 2022] DELETE /identity/v3/projects/29b83e363dde4f2c9b777ca45235de6d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:04.036472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.036564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aa9fe-3e34-407a-bd77-9e9f2bdf35c2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.041901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.179044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:04.180025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:04.180409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:04.180592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] PATH_INFO: `/v3/projects/aa0543a9f409480686023b67aa0eab80` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:04.183622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0543a9f409480686023b67aa0eab80)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:04.188078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:04.290880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd5c33-921c-462e-ac8b-ad75cb4b0ee9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.345799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:04.346705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:04.348863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:04.351919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:04.353026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:04.354008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:04.357826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:04.363818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0543a9f409480686023b67aa0eab80', 'request_id': 'req-93c7db55-08ce-4d17-8a81-838ea1268de0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.385615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0543a9f409480686023b67aa0eab80', 'request_id': 'req-93c7db55-08ce-4d17-8a81-838ea1268de0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.401206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0543a9f409480686023b67aa0eab80', 'request_id': 'req-93c7db55-08ce-4d17-8a81-838ea1268de0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.414269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 903/1804] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:04 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:04.415443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.418600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.437813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] The token cache is being invalidate because project aa0543a9f409480686023b67aa0eab80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:04.438749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.441412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.446157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 902/1805] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:03 2022] DELETE /identity/v3/projects/aa0543a9f409480686023b67aa0eab80 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:04.446357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cade47-b50d-4b70-bbe1-1dd98edb7cb2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.450254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.462323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.601604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:04.603566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:04.604689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:04.606003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] PATH_INFO: `/v3/users/3fb1993fbb814ccc82f40f4464f2542c` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:04.609602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb1993fbb814ccc82f40f4464f2542c)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:04.618563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:04.650278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7db55-08ce-4d17-8a81-838ea1268de0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.677640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:04.679139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:04.679438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:04.679793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:04.680602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:04.682188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:04.705666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 903/1806] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:04.706470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.713752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.732655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee1a14-d105-409c-af6a-ebf80baa1b22 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.736477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb1993fbb814ccc82f40f4464f2542c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.739612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:04.739612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:04.739612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:04.739612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] PATH_INFO: `/v3/users/298cbe35641840c0bd918d338b07ab43` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:04.740758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=298cbe35641840c0bd918d338b07ab43)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:04.743526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:04.780157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb1993fbb814ccc82f40f4464f2542c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.781504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb1993fbb814ccc82f40f4464f2542c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.782453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb1993fbb814ccc82f40f4464f2542c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.810102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb1993fbb814ccc82f40f4464f2542c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.843146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298cbe35641840c0bd918d338b07ab43'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.844184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298cbe35641840c0bd918d338b07ab43'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.844931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298cbe35641840c0bd918d338b07ab43'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.845732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 904/1807] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:04 2022] DELETE /identity/v3/users/3fb1993fbb814ccc82f40f4464f2542c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:04.847393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.848942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.857655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298cbe35641840c0bd918d338b07ab43'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.864214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:04.887056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298cbe35641840c0bd918d338b07ab43'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:04.915385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 904/1808] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:04 2022] DELETE /identity/v3/users/298cbe35641840c0bd918d338b07ab43 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:04.916416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:04.918055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:04.976900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395585d-bfc3-44d1-8201-cdc0f3e60d14 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:04.982796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:05.018413 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b01d57-4b18-4125-b71e-2a6009c03e3c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.032188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.034096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.034529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.034962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] PATH_INFO: `/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.036884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2dd490da4f4c76aeb12f16441d25f1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.038864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.057020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.058076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.058365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.058643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] PATH_INFO: `/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3/users/3573ee377bfc4b86a08e49444c44d2de/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.082810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d473fee9cf144ac98c38e8a2da2c7c3, user_id=3573ee377bfc4b86a08e49444c44d2de, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.087665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef5ff0-5186-43ff-84e8-f0d9bc544b88 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.102576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2dd490da4f4c76aeb12f16441d25f1', 'request_id': 'req-fb4e4249-34ab-4b3a-b48d-b12840f39a95'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.109168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 905/1809] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:04 2022] PUT /identity/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3/users/3573ee377bfc4b86a08e49444c44d2de/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:05.111214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.111675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.112484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.113300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2dd490da4f4c76aeb12f16441d25f1', 'request_id': 'req-fb4e4249-34ab-4b3a-b48d-b12840f39a95'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.122786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2dd490da4f4c76aeb12f16441d25f1', 'request_id': 'req-fb4e4249-34ab-4b3a-b48d-b12840f39a95'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.132380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 906/1810] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:06:05 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:06:05.133809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.137358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.140471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] The token cache is being invalidate because project 8b2dd490da4f4c76aeb12f16441d25f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:05.140786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.141699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb4e4249-34ab-4b3a-b48d-b12840f39a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.147118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 905/1811] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:04 2022] DELETE /identity/v3/projects/8b2dd490da4f4c76aeb12f16441d25f1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:05.149384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681890-9df4-4a91-805f-234b734bc2f8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.149817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681890-9df4-4a91-805f-234b734bc2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.150099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681890-9df4-4a91-805f-234b734bc2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.172923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a8681890-9df4-4a91-805f-234b734bc2f8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.174447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8681890-9df4-4a91-805f-234b734bc2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.245555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a357c-35ab-4494-a6bf-6ed0cd6175eb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.253085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.254190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.254477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.254872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.255812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.258284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9599-7c18-41c0-b5d9-4f56484b62a8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.258924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 906/1812] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:05.260661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.261074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.262420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.279136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 907/1813] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:05.280504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.280793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.281119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.288942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.290411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.301673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.302891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.319829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 908/1814] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:05.320721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.322381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.336162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a0e3-83e1-4799-9940-92b542f59ed4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.341459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.342349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.342629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.342902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] PATH_INFO: `/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3/users/3573ee377bfc4b86a08e49444c44d2de/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.345123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d473fee9cf144ac98c38e8a2da2c7c3, user_id=3573ee377bfc4b86a08e49444c44d2de, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.347801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.377887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 909/1815] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:05 2022] PUT /identity/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3/users/3573ee377bfc4b86a08e49444c44d2de/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:05.377887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.398882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:05.415824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 907/1816] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:05.417552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.419884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.433605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:05.438399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1426-f7bf-4c45-803a-fb100d463683 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.494162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5940e-8924-4b7b-8aee-71b9144f8c39 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.499720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.500409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.500693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.500973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.501705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:05.502010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.503639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e01b9-4c39-4a0c-ab1a-b02bf5572bc6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.516690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 910/1817] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:05.518123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.518412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.518691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.525137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.526046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.526365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.526629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] PATH_INFO: `/v3/projects/753eefac7ea3423fba4b68a59a42c11d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.528011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753eefac7ea3423fba4b68a59a42c11d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.529908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.554663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] MFA Rules not processed for user `3573ee377bfc4b86a08e49444c44d2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.556417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.589326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753eefac7ea3423fba4b68a59a42c11d', 'request_id': 'req-5619786b-2b3f-4218-8436-c4f994dddac5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.598857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753eefac7ea3423fba4b68a59a42c11d', 'request_id': 'req-5619786b-2b3f-4218-8436-c4f994dddac5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.605103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753eefac7ea3423fba4b68a59a42c11d', 'request_id': 'req-5619786b-2b3f-4218-8436-c4f994dddac5'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.626279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] The token cache is being invalidate because project 753eefac7ea3423fba4b68a59a42c11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:05.626693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.627639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.631662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 908/1818] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:05 2022] DELETE /identity/v3/projects/753eefac7ea3423fba4b68a59a42c11d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:05.632527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.634798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.640386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 911/1819] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:05.640816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.642232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.701774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619786b-2b3f-4218-8436-c4f994dddac5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.706870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.707783 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.708067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.708344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] PATH_INFO: `/v3/projects/b6ebabe634494e648a49b3b0c24883f2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.710090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ebabe634494e648a49b3b0c24883f2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.712289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.734536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f85da-b168-40a9-b6a0-81ed26d19f04 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.750794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:05.761747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ebabe634494e648a49b3b0c24883f2', 'request_id': 'req-62649dc9-7d5d-497f-ac2b-93e6402333b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.766406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:05.771105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ebabe634494e648a49b3b0c24883f2', 'request_id': 'req-62649dc9-7d5d-497f-ac2b-93e6402333b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.777208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ebabe634494e648a49b3b0c24883f2', 'request_id': 'req-62649dc9-7d5d-497f-ac2b-93e6402333b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.788566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] The token cache is being invalidate because project b6ebabe634494e648a49b3b0c24883f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:05.788857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.789525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:05.791184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 909/1820] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:05 2022] DELETE /identity/v3/projects/b6ebabe634494e648a49b3b0c24883f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:05.791968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.793198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.804412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.805183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.805482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.805763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.807743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.821096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.822628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f5788-6c5c-4162-bd2f-018cd0668104 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.835211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 912/1821] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:05.836870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.837284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.837574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.862357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.863792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.864974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649dc9-7d5d-497f-ac2b-93e6402333b4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:05.870983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:05.871851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.872260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.872648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.880029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 913/1822] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:05.880308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:05.880399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:05.880399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.880585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660135a-63fa-4ab9-b032-82fb7b929582 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:05.911189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 910/1823] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:05.912868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369587-d6f3-4236-b8bf-1270d2bf2403 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:05.913237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369587-d6f3-4236-b8bf-1270d2bf2403 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:05.913608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80369587-d6f3-4236-b8bf-1270d2bf2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:05.944408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-80369587-d6f3-4236-b8bf-1270d2bf2403 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:05.945045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-80369587-d6f3-4236-b8bf-1270d2bf2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:05.956265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975e96-c472-4d16-98d1-3489f553f242 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.008061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.008753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.009098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.009285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 911/1824] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:06.009440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.011325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.013076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.013446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.013917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.032848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:06.034055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.042057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 912/1825] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:06.042801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.051915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbca0b-fe66-4d20-b567-99ffe813c11a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.057019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.057665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.057948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.058232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.059041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.060982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e77be4-926b-4748-a6ea-1f77c2581ba3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.077752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.079281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.084818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 913/1826] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/users => generated 291 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.084818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.084818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.084818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.090818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 914/1827] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:06.091675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.102320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de20e-fefd-4422-a911-9eb3d741caaa service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.104211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:06.105925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.107090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.107780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.108070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.108348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.109099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:06.109411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.110982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.115009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 914/1828] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:06.115879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.127575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 915/1829] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:06.128445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.129145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104719-db32-4a51-bfd4-d7f5dac600e1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.134104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:06.135125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.135976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.136241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.136522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.137286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.138966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.141559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96667e-c09d-4f9a-951d-f9026fcbd6a9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.146870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.147535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.147838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.148146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.148867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:06.149172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.153262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 915/1830] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.153389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.153474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.161258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb19c0-61f9-4dc1-970c-fcd13106cb25 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.168761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 916/1831] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:06.168761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.168981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.168981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.168981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.168981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.169341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.170918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.176532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdd-f96c-4451-98e8-6167e2971fc2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.176699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:06.181947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.182540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.183673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.183673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.183937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.185467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.196954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 917/1832] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.197793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.207615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdf42-82c0-4e34-90ef-02e0926e53b0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.218695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 916/1833] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.218695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.220017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.221126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.221468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.221751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.222496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.224470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.255669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 918/1834] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.257409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.273458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af230150-9e61-40f2-a568-ca0d2be67ed4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.320245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353ad9c-3aef-459b-b11c-b0cd475e5120 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.321363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.322087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.322384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.322659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.324518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.325087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.325964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.326249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.326526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] PATH_INFO: `/v3/projects/66e0b6910845438f80a77823a1e08e40/users/2b4a05d655ae4acd8ebb9500ae0c72b9/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.342301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e0b6910845438f80a77823a1e08e40, user_id=2b4a05d655ae4acd8ebb9500ae0c72b9, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.345037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.358143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 919/1835] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:06 2022] PUT /identity/v3/projects/66e0b6910845438f80a77823a1e08e40/users/2b4a05d655ae4acd8ebb9500ae0c72b9/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:06.360765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.389797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.391246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.400287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 917/1836] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:06.401057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.411949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c9f0-d69f-4c3d-b00a-c817d9a9f33b service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.428531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52959-b826-4c13-998b-4f927dfaabd0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.434079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.434882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.435234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.435614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.436367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.438466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa555e3-2051-40ab-b52a-ff8deefc1c9d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.463555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 920/1837] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.464430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.464737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.465023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.469472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:06.478563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.479477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.479781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.480488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.481432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.483941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.498890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] MFA Rules not processed for user `2b4a05d655ae4acd8ebb9500ae0c72b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:06.500642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.509718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 918/1838] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.510635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.522172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cab1b-264b-4276-adaf-f7b589320f28 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.524076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:06.533315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.534048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.534366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.534648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.535531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.539148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.555813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 919/1839] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.555813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.567174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1d6f-8fa9-4c6f-ac78-4b7db7a0c0af admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.572567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.573432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.573789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.574136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.574930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.576743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.588885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 921/1840] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:06.589780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.594683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 920/1841] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.595614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.601290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c8fd-ad17-4538-beae-0a1369505187 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.606267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.606943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.607330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.607646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.608073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83be24-4593-48f1-9001-5065361e0a93 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.608428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.610301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.614250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.615027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.615575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.615848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.616653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.618796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.624280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 922/1842] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.624280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.637712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf291ed-b885-472a-9f28-7f23ff7f3645 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.643143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.644074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.644570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.644928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.645734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.647955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.654412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 921/1843] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.654412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.660224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 923/1844] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.661096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.671820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8000-33ba-48fd-8dc4-536c30bcf8fe admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.733553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41fc6a-673d-4333-91da-2e04bc8fc8d4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.740911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.740911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.741263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.741615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] PATH_INFO: `/v3/projects/828989ac76a54cc5b26648da1289f237/users/5ada69fe900f4d5aa82bc7b5dd999139/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.744498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.745522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.746276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.746276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.747072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.749292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.758764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] RBAC: Authorizing `identity:create_grant(project_id=828989ac76a54cc5b26648da1289f237, user_id=5ada69fe900f4d5aa82bc7b5dd999139, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.761807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.779795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 924/1845] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:06.780780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.786209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 922/1846] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:06 2022] PUT /identity/v3/projects/828989ac76a54cc5b26648da1289f237/users/5ada69fe900f4d5aa82bc7b5dd999139/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:06.787127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:06.791994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041b813-bc2a-4987-85d5-fa0311a9f90a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.855230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.856613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.856903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.857203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] PATH_INFO: `/v3/projects/76dc8db98aaa4b878dd353f63923e36d/users/e9a41a526dff4743abbc2be098fab0c3/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.878869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837b93-291e-4d7c-8b97-3b963f32620c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:06.879263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dc8db98aaa4b878dd353f63923e36d, user_id=e9a41a526dff4743abbc2be098fab0c3, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.882734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf96e9-3154-4e50-a0aa-d7cb75faafd6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.886932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:06.887714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.888066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.888471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.889491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:06.891154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc63c9-2bb0-4e67-bd97-bbbbb7077003 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:06.897963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 925/1847] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:06 2022] PUT /identity/v3/projects/76dc8db98aaa4b878dd353f63923e36d/users/e9a41a526dff4743abbc2be098fab0c3/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:06.899377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.899724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.900007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.914733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 923/1848] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:06.914733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:06.914733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:06.914733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:06.919125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:06.930083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] MFA Rules not processed for user `5ada69fe900f4d5aa82bc7b5dd999139`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:06.931359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.942308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] MFA Rules not processed for user `e9a41a526dff4743abbc2be098fab0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:06.944110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:06.955280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:07.025334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 926/1849] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:07.030003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.052383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 924/1850] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:07.054511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.151561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81433e-ac1d-4954-a845-f6dbb815419d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.154513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.155870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.156196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.156785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] PATH_INFO: `/v3/projects/a32bddaaa004444fb303d02a5d15790a/users/2bc85c4768394672a75c20e6edad5898/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.168537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfeb89-fdd3-4dcb-ba72-8b945808bb3f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.172697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32bddaaa004444fb303d02a5d15790a, user_id=2bc85c4768394672a75c20e6edad5898, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.173249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.173913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.174200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.174478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.175174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.175487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.177128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.198045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 927/1851] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:07 2022] PUT /identity/v3/projects/a32bddaaa004444fb303d02a5d15790a/users/2bc85c4768394672a75c20e6edad5898/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:07.199020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.234659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 925/1852] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:07.234659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.308925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4f45-9c41-432a-b0ea-1c602a9b7006 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.333472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cbc3e-febe-4f1d-b2f8-e7b1702dd3e0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.338612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:07.340363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.341460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.341754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.342203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.342951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.345503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.358872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 926/1853] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:07.359806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.374659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a1b-0772-43d4-9ffd-63fff65970a0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.379898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.380579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.380866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.381700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.382681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.385042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.386488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.387262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.387704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.388089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.388900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.390934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.408926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 927/1854] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:07 2022] POST /identity/v3/users => generated 299 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:07.410116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.420959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b71-af31-4362-80d4-b15003aaab7b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.421996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 928/1855] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:07 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:07.424490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.438541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:07.496833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.497926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.498148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.498619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] PATH_INFO: `/v3/projects/a32bddaaa004444fb303d02a5d15790a/users/2bc85c4768394672a75c20e6edad5898/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.500613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32bddaaa004444fb303d02a5d15790a, user_id=2bc85c4768394672a75c20e6edad5898, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.503471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.512822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e19-27d6-4084-b2d2-38765040a45d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.514872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 928/1856] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:07 2022] PUT /identity/v3/projects/a32bddaaa004444fb303d02a5d15790a/users/2bc85c4768394672a75c20e6edad5898/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:07.524877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.596636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.598057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.598446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.598821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.600585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.603160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63c99-2a8c-4e4d-bca9-aefd00c15284 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.615285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580547-ffe9-4dd1-97c6-35a7f52b01e1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.621335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 929/1857] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:07.621335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.621335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.621335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.624618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.625301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.625590 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.625868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.626598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.628719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.674573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 929/1858] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:07 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:07.677776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.691044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] MFA Rules not processed for user `2bc85c4768394672a75c20e6edad5898`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:07.692163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc3bd-1c85-4356-9d94-118ec4f5ce14 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.692513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:07.701199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.702426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.702716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.703061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] PATH_INFO: `/v3/projects/4700c795c1e14c70aeb15da7660bd2b1/users/c9fc933e3ad34b838592a6c54e54a3da/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.728805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4700c795c1e14c70aeb15da7660bd2b1, user_id=c9fc933e3ad34b838592a6c54e54a3da, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.732541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.753030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 930/1859] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:07 2022] PUT /identity/v3/projects/4700c795c1e14c70aeb15da7660bd2b1/users/c9fc933e3ad34b838592a6c54e54a3da/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:07.754340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.791367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:07.864346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 930/1860] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:07.866004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.903596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0640-5ad3-4063-8f01-986e3906963f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.913359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e9bed-8e5d-49b5-ab6b-dc68482d994e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:07.919696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.921099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.922328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.922971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.924218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.928454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:07.931099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:07.931391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:07.931706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:07.933354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.933929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:07.939041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:07.970274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 931/1861] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:07.971450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:07.977314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:07.983166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 931/1862] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:07.985296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.021041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9ec8-f31b-4b00-a8fb-5473f8f0d951 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.034791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.035889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.036661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.036766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] PATH_INFO: `/v3/projects/4700c795c1e14c70aeb15da7660bd2b1/users/c9fc933e3ad34b838592a6c54e54a3da/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.040228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4700c795c1e14c70aeb15da7660bd2b1, user_id=c9fc933e3ad34b838592a6c54e54a3da, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.043214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.070669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:08.080239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 932/1863] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:07 2022] PUT /identity/v3/projects/4700c795c1e14c70aeb15da7660bd2b1/users/c9fc933e3ad34b838592a6c54e54a3da/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:08.087546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.167955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24733ad-a3c2-4a30-9264-a47644ba3b21 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.289317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2b80-7e05-4418-a228-1addf1b7f1d8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.300846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.302423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.302423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.302423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.307928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.308883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.309173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.309454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] PATH_INFO: `/v3/projects/ac3974772856444e864d5622425241d9/users/b9886814007c459ca27df70faa403a2c/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.326389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3974772856444e864d5622425241d9, user_id=b9886814007c459ca27df70faa403a2c, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.329800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0fe9b-be1e-4ddc-84b1-412048735c32 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.359789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 933/1864] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:08 2022] PUT /identity/v3/projects/ac3974772856444e864d5622425241d9/users/b9886814007c459ca27df70faa403a2c/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:08.361511 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.361889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.362225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.413892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] MFA Rules not processed for user `c9fc933e3ad34b838592a6c54e54a3da`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:08.415567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:08.456453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.462850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.512913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 932/1865] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:08.514971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.543374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81842-35bf-4e7a-8f0c-aafb70b60ea7 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.605455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 934/1866] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:08.640825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:08.643774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.736080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.736985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.737387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.738067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.738918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.741808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.755992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93614b1-a352-4ced-9f29-3bbf3597351f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.760792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 933/1867] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:08.762178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.767103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.768685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.769140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.771110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.788989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c528-ce41-4fe5-88c3-9b26acb18ccc admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:08.795943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.799123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ceed-c58c-4422-a824-0c2dad8a317c service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.802001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:08.805148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.805436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.808016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] PATH_INFO: `/v3/projects/ac3974772856444e864d5622425241d9/users/b9886814007c459ca27df70faa403a2c/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.811369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3974772856444e864d5622425241d9, user_id=b9886814007c459ca27df70faa403a2c, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:08.821706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:08.832185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 935/1868] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:08.851716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 934/1869] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:08 2022] PUT /identity/v3/projects/ac3974772856444e864d5622425241d9/users/b9886814007c459ca27df70faa403a2c/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:08.864741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:08.865936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:08.866468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:08.910838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:08.950078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:08.953088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] MFA Rules not processed for user `b9886814007c459ca27df70faa403a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:08.954508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.102143 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8a932-2eb6-4297-a123-34a14ec6b588 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:09.108067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:09.108806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 936/1870] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:09.114679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.115133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.116101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] PATH_INFO: `/v3/users/5ada69fe900f4d5aa82bc7b5dd999139` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.118199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ada69fe900f4d5aa82bc7b5dd999139)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:09.120805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:09.121097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:09.246981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ada69fe900f4d5aa82bc7b5dd999139'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.256232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f145d-ffff-4c59-8d3e-8ebe25bc0546 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:09.263352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:09.266420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.266722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.267003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.277114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ada69fe900f4d5aa82bc7b5dd999139'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.278127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ada69fe900f4d5aa82bc7b5dd999139'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.278839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ada69fe900f4d5aa82bc7b5dd999139'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.290015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ada69fe900f4d5aa82bc7b5dd999139'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.295917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:09.297459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c11dac-7efd-42d3-b3d3-cc751afaac28 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:09.322291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 937/1871] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:09.344579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 935/1872] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:08 2022] DELETE /identity/v3/users/5ada69fe900f4d5aa82bc7b5dd999139 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:09.350698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.351468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.351965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.384229 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:09.386709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.401244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:09.418319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.465008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:09.511901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab668c-9fd1-4a5b-9a6b-ca194bac3b2c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:09.518728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:09.520060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.520353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.520781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] PATH_INFO: `/v3/users/2b4a05d655ae4acd8ebb9500ae0c72b9` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.522458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4a05d655ae4acd8ebb9500ae0c72b9)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:09.525181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:09.647606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 938/1873] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:09.648668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:09.655019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4a05d655ae4acd8ebb9500ae0c72b9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.658593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.705979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4a05d655ae4acd8ebb9500ae0c72b9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.708630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4a05d655ae4acd8ebb9500ae0c72b9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.710857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4a05d655ae4acd8ebb9500ae0c72b9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.737821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4a05d655ae4acd8ebb9500ae0c72b9'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:09.774710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:09.794492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 936/1874] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:09 2022] DELETE /identity/v3/users/2b4a05d655ae4acd8ebb9500ae0c72b9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:09.797546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:09.800872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.817981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9c1f-4035-488e-9b25-a3b36d236d1c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:09.932804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440736ac-ef43-47a6-8352-35b8e1a74387 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:09.954308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:09.955225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.955334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:09.955872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.956330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.958243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:09.958589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:09.958965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:09.963123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:09.972029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:10.039340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:10.041072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ddc62-0f70-4063-921f-811630dc6e89 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:10.055065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 937/1875] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:10.057570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:10.058127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:10.058559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:10.084736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:10.087287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:10.099321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 938/1876] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:10.159885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:10.161355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:10.190308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:10.197668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 939/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:10.202164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f5e1-2381-4c7e-80f2-536c83a47196 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:10.203604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:10.216899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:10.218353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:10.230277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:10.231320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:10.262999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:10.265672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:10.297663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 939/1878] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:11.271277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:11.274579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:11.291769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f27ba-5262-4028-ac54-744b0a5cda1d service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:11.297481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:11.299368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:11.300196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:11.300966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] PATH_INFO: `/v3/projects/828989ac76a54cc5b26648da1289f237` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:11.303579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828989ac76a54cc5b26648da1289f237)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:11.309000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:11.310759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:11.311697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:11.336513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2893-e75f-4bcd-b5e2-086826786bc1 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:11.349042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:11.349042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:11.349042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:11.349042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] PATH_INFO: `/v3/projects/66e0b6910845438f80a77823a1e08e40` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:11.349599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e0b6910845438f80a77823a1e08e40)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:11.349599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:11.400656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828989ac76a54cc5b26648da1289f237', 'request_id': 'req-fb59de43-7225-466f-bd3d-4b545e4a3495'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.401693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e0b6910845438f80a77823a1e08e40', 'request_id': 'req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.410843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828989ac76a54cc5b26648da1289f237', 'request_id': 'req-fb59de43-7225-466f-bd3d-4b545e4a3495'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.411122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e0b6910845438f80a77823a1e08e40', 'request_id': 'req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.417287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e0b6910845438f80a77823a1e08e40', 'request_id': 'req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.417625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828989ac76a54cc5b26648da1289f237', 'request_id': 'req-fb59de43-7225-466f-bd3d-4b545e4a3495'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.433046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] The token cache is being invalidate because project 828989ac76a54cc5b26648da1289f237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:11.433265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] The token cache is being invalidate because project 66e0b6910845438f80a77823a1e08e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:11.433352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.433821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.434038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.434502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.436255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 940/1879] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:11 2022] DELETE /identity/v3/projects/828989ac76a54cc5b26648da1289f237 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:11.437068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 940/1880] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:11 2022] DELETE /identity/v3/projects/66e0b6910845438f80a77823a1e08e40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:11.440447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:11.440956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:11.442338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:11.444366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:11.488066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:11.529544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59de43-7225-466f-bd3d-4b545e4a3495 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:11.531605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a894e-02c5-4faa-921c-3bf23dbe3dc1 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:11.534635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:11.535813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:11.536175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:11.536560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] PATH_INFO: `/v3/users/c9fc933e3ad34b838592a6c54e54a3da` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:11.536795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:11.537818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:11.537995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fc933e3ad34b838592a6c54e54a3da)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:11.538237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:11.538579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] PATH_INFO: `/v3/users/2bc85c4768394672a75c20e6edad5898` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:11.539921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc85c4768394672a75c20e6edad5898)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:11.540032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:11.541986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:11.607597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc85c4768394672a75c20e6edad5898'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.611760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fc933e3ad34b838592a6c54e54a3da'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.612735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fc933e3ad34b838592a6c54e54a3da'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.613635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fc933e3ad34b838592a6c54e54a3da'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.626525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fc933e3ad34b838592a6c54e54a3da'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.628401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc85c4768394672a75c20e6edad5898'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.630117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc85c4768394672a75c20e6edad5898'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.632491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc85c4768394672a75c20e6edad5898'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.645650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fc933e3ad34b838592a6c54e54a3da'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.648262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc85c4768394672a75c20e6edad5898'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:11.651633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:11.667840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 941/1881] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:11 2022] DELETE /identity/v3/users/c9fc933e3ad34b838592a6c54e54a3da => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:11.671873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 941/1882] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:11 2022] DELETE /identity/v3/users/2bc85c4768394672a75c20e6edad5898 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:12.012579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.014668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.027905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.029356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.181692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22722e2b-8559-436f-975a-de796d9e9ae6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.182236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb45a6-ac1e-445a-9950-23eb7df2d429 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.187492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.188340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.188675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.189067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.189414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] PATH_INFO: `/v3/projects/a32bddaaa004444fb303d02a5d15790a` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.189552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.189900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.190302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] PATH_INFO: `/v3/projects/4700c795c1e14c70aeb15da7660bd2b1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.190924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32bddaaa004444fb303d02a5d15790a)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.192004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4700c795c1e14c70aeb15da7660bd2b1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.194212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.199336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.272667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4700c795c1e14c70aeb15da7660bd2b1', 'request_id': 'req-ef48f8aa-1e36-476e-add0-adaf807f2d3e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.273145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32bddaaa004444fb303d02a5d15790a', 'request_id': 'req-db74be9f-1d10-47f7-9f74-0d3396921413'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.275594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:12.282918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32bddaaa004444fb303d02a5d15790a', 'request_id': 'req-db74be9f-1d10-47f7-9f74-0d3396921413'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.284058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4700c795c1e14c70aeb15da7660bd2b1', 'request_id': 'req-ef48f8aa-1e36-476e-add0-adaf807f2d3e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.290220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32bddaaa004444fb303d02a5d15790a', 'request_id': 'req-db74be9f-1d10-47f7-9f74-0d3396921413'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.291682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4700c795c1e14c70aeb15da7660bd2b1', 'request_id': 'req-ef48f8aa-1e36-476e-add0-adaf807f2d3e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.304914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] The token cache is being invalidate because project 4700c795c1e14c70aeb15da7660bd2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:12.305215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.305900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef48f8aa-1e36-476e-add0-adaf807f2d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.311563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 942/1883] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:12 2022] DELETE /identity/v3/projects/4700c795c1e14c70aeb15da7660bd2b1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:12.312934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9c2c-cd17-4c13-aa58-2023e066db16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.313894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9c2c-cd17-4c13-aa58-2023e066db16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.314329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9c2c-cd17-4c13-aa58-2023e066db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.315393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] The token cache is being invalidate because project a32bddaaa004444fb303d02a5d15790a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:12.315871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.316649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-db74be9f-1d10-47f7-9f74-0d3396921413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:12.322669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 942/1884] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:12 2022] DELETE /identity/v3/projects/a32bddaaa004444fb303d02a5d15790a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:12.324260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d41e-2321-4158-afcd-19275ba00961 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.328136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d41e-2321-4158-afcd-19275ba00961 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.328136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d41e-2321-4158-afcd-19275ba00961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.334049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d00a9c2c-cd17-4c13-aa58-2023e066db16 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.335544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d00a9c2c-cd17-4c13-aa58-2023e066db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.345106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f0e0d41e-2321-4158-afcd-19275ba00961 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.346277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f0e0d41e-2321-4158-afcd-19275ba00961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.403550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 943/1885] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:12.406677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.407001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.407284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.417149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 943/1886] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:12.424596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.424883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.425162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.426270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.427707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.437678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 944/1887] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:12.441913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.448370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.450025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.451038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee9136-f3d1-4954-abe1-6ced199e4f63 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.455726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.456410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.456654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.456930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.457652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:12.457956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.459426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 944/1888] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:12.460478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.464080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.472538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 945/1889] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:12.477159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.477748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cca733-ab85-467b-8df0-704328e8bf71 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.483738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.484398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.484956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.485238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.486493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:12.486493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.487002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371332-10b7-4cc2-9809-9cc6a4f8c825 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.488106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.492238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.492977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.493325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.493674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.494433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.496436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.504391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 945/1890] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:12.505586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.511392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:12.517889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53392d-465d-4997-b089-28ba84c689c5 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.524774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.525611 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.525735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.526198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.527164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.528796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 946/1891] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:12.529564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.532562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.563779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 946/1892] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:12.564757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.598148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b49b77-f14f-40b8-96b4-f3c56be2837f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.625961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488372e-e89a-466d-bb93-4866d5108567 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.636316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.637366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.637938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.638872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.639762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.641938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.644220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:12.660252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.660923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.661212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.661488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.662749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.664218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 947/1893] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/users => generated 280 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:12.664740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.668418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.678926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8b5b7-9b1f-45be-9532-dfd1966d932b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.683587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.684238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.684522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.684820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.688247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 947/1894] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:12.688371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.688371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.689362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.697997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 948/1895] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:12.701508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.701777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6c2d7-5b88-46e9-b5fd-aa31f30d976c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.706571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.707228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.707532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.707833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.708556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.710947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.712012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba337fe-2414-4aba-8729-300962f63169 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.716577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.717207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.717491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.717799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.718511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.720099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.720918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 948/1896] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:12.725299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.734048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 949/1897] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:12.734763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91461297-532b-431e-a7d3-3eeee0d49aaf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.734889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.739540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.740216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.740502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.740781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.741500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.743076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.744639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c614-f39d-4a27-acba-622037ad0377 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.749218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.750096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.750483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.750656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] PATH_INFO: `/v3/projects/ae14ee9ba7bc4d6d82ca19f5de10e2a5/users/d7137d7a12e44b7fbe1a50ec0a87e3ff/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.753872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 949/1898] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:12.757848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.765920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae14ee9ba7bc4d6d82ca19f5de10e2a5, user_id=d7137d7a12e44b7fbe1a50ec0a87e3ff, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.767286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeede2-7ea2-4f0a-82ec-31dc1bdd8d2a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.768646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59585489-6004-4fa5-8cdb-04e0a3e6f463 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.772491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.773352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.773646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.773999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] PATH_INFO: `/v3/projects/a0bd0f48e8d247dc94b384cdff9fd77d/users/a4cc20334d2e4e7eb7c29636f46efd04/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.783358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 950/1899] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:12 2022] PUT /identity/v3/projects/ae14ee9ba7bc4d6d82ca19f5de10e2a5/users/d7137d7a12e44b7fbe1a50ec0a87e3ff/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:12.794379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bd0f48e8d247dc94b384cdff9fd77d, user_id=a4cc20334d2e4e7eb7c29636f46efd04, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:12.795014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.795311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.795631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.797355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1250-a84b-4536-bc68-061ffa117561 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:12.810517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 950/1900] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:12 2022] PUT /identity/v3/projects/a0bd0f48e8d247dc94b384cdff9fd77d/users/a4cc20334d2e4e7eb7c29636f46efd04/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:12.822258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] MFA Rules not processed for user `d7137d7a12e44b7fbe1a50ec0a87e3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.822394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.822549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.822828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.823481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.851522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] MFA Rules not processed for user `a4cc20334d2e4e7eb7c29636f46efd04`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:12.856145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.898418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 951/1901] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:12.923398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 951/1902] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:12.927687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.930103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:12.931445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:12.941188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:12.990340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a4a6-c93d-4112-b187-2bbf675aba8b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.992537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95de4-6023-4ac8-9f7b-036778a0ec77 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:12.993918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.994563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.994849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.995127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.997351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:12.998026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:12.998314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:12.998593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:12.999291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.001270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.003415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.004870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.014537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 952/1903] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:13.029246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.033260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 952/1904] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:12 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:13.037093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.040079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a89be-1b1c-490e-b02c-177b48286ac3 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.060260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:13.099775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae305-c53f-4078-92dd-95cd2f3b596b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.100742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.102247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.102749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.103046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] PATH_INFO: `/v3/users/d7137d7a12e44b7fbe1a50ec0a87e3ff` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.104577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7137d7a12e44b7fbe1a50ec0a87e3ff)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.105164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.105915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.106264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.106605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.107350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.107466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.109650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.135534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 953/1905] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:13 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:13.137134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.149455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a36aee-ce4b-473d-b66b-a218a22c7ee4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.155186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.155873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.156165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.156427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.157145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.158737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.168142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7137d7a12e44b7fbe1a50ec0a87e3ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:13.168828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7137d7a12e44b7fbe1a50ec0a87e3ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:13.169456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7137d7a12e44b7fbe1a50ec0a87e3ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:13.172736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 954/1906] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:13.174100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.176110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:13.178190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7137d7a12e44b7fbe1a50ec0a87e3ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:13.190198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d044766-032b-4b70-87aa-418d8b18df25 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.195988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.197139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.197462 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.197791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] PATH_INFO: `/v3/projects/7620a49bb31e45779c0e966d6f330656/users/520cd86f673a425a956c726fa1e77cf1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.199439 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4964bb5f-0fa3-48a3-9428-ebe15862b069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7137d7a12e44b7fbe1a50ec0a87e3ff'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:13.218153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620a49bb31e45779c0e966d6f330656, user_id=520cd86f673a425a956c726fa1e77cf1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.220149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 953/1907] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:13 2022] DELETE /identity/v3/users/d7137d7a12e44b7fbe1a50ec0a87e3ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:13.221877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.225963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.226266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.226718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.238732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 955/1908] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:13 2022] PUT /identity/v3/projects/7620a49bb31e45779c0e966d6f330656/users/520cd86f673a425a956c726fa1e77cf1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:13.243242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.246179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:13.247492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:13.360718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:13.381560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be61dc-38d9-4e95-9569-3842eef20654 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.400105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.400793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.401073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.401343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.402077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.408034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.428188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 954/1909] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:13.438512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.442915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 956/1910] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:13.443052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:13.446716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.484011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e19a-fa33-45e4-98d5-6fd31f09a978 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.508900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.511762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.512004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.514272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] PATH_INFO: `/v3/projects/7620a49bb31e45779c0e966d6f330656/users/520cd86f673a425a956c726fa1e77cf1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.522209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620a49bb31e45779c0e966d6f330656, user_id=520cd86f673a425a956c726fa1e77cf1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.525501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7930-9e79-4acf-bff0-39c4eb1d490d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.565421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:13.567040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 957/1911] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:13 2022] PUT /identity/v3/projects/7620a49bb31e45779c0e966d6f330656/users/520cd86f673a425a956c726fa1e77cf1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:13.586650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.586942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.587296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.591042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d2709-f073-41e4-94f7-416bb0d56762 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.647262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] MFA Rules not processed for user `520cd86f673a425a956c726fa1e77cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:13.648532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:13.668375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.669038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.669324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.669903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.735181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 958/1912] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:13.749783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:13.752167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:13.785287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:13.787311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:13.805170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 955/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:13.854620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8132e-c8f2-4968-8904-11530194d112 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:13.866625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:13.869476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:13.871929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:13.872963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:13.878066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:14.006998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.013633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f08e83-659d-4a9a-92fe-1f910dd59f06 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.026594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 959/1914] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:14.192397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:14.194672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:14.220220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fff43-1c6d-4f7b-9147-3ab0b5f846f0 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:14.232897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:14.234260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.234691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.237137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] PATH_INFO: `/v3/projects/ae14ee9ba7bc4d6d82ca19f5de10e2a5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.238669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae14ee9ba7bc4d6d82ca19f5de10e2a5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.242145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.355700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae14ee9ba7bc4d6d82ca19f5de10e2a5', 'request_id': 'req-0a26cf4e-76e3-4e24-8eba-4661b8341036'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:14.368802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae14ee9ba7bc4d6d82ca19f5de10e2a5', 'request_id': 'req-0a26cf4e-76e3-4e24-8eba-4661b8341036'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:14.381274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae14ee9ba7bc4d6d82ca19f5de10e2a5', 'request_id': 'req-0a26cf4e-76e3-4e24-8eba-4661b8341036'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:14.397667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] The token cache is being invalidate because project ae14ee9ba7bc4d6d82ca19f5de10e2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:14.397950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:14.399978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0a26cf4e-76e3-4e24-8eba-4661b8341036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:14.407619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 956/1915] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:14 2022] DELETE /identity/v3/projects/ae14ee9ba7bc4d6d82ca19f5de10e2a5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:14.412998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.413694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.413694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.441647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:14.441786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:14.455302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:14.584959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 960/1916] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:14.589314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.589834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.590590 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.641227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:14.645638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:14.683252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:14.689431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 957/1917] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:14.694746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d65c80-c2e5-4192-9069-8ac0a1f5907c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:14.715274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:14.718059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.718467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.718851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.719728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:14.720655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.725577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.755768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 961/1918] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:14.756848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:14.768863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064449a4-44a8-4064-b8a8-1c2bc57c44c7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:14.774841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:14.775571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.775859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.776165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.776911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.781795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.813177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 958/1919] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:14 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:14.817386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:14.829315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e794b-a616-4590-902b-5d679f50edc7 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:14.913493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:14.916115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.916369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.916631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.917453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.923979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.952046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 962/1920] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:14 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:14.956765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:14.965433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:14.971868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b230b0-4b47-494e-8f97-48102f5bd0a2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:14.980061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:14.981143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:14.982155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:14.982477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:14.983383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:14.986348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:14.997661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 959/1921] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:15.001779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:15.013220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688403f-d118-41bc-8398-a8015e5c1ad6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:15.019052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:15.019896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:15.020280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:15.020642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:15.021938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:15.023529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b7e52-2c63-4f13-a73e-1c3d8778ca5a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:15.034939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 963/1922] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:15.041746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:15.050921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa597e-a353-4a72-b7ca-706406c8d8ba admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:15.055981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:15.057028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:15.057320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:15.057593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] PATH_INFO: `/v3/projects/c5fb00f72c1347fe9b5b9a6320865c8e/users/fa98454857524eb8a6de7f5507049d50/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:15.074152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fb00f72c1347fe9b5b9a6320865c8e, user_id=fa98454857524eb8a6de7f5507049d50, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:15.076603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:15.092212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 960/1923] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:15 2022] PUT /identity/v3/projects/c5fb00f72c1347fe9b5b9a6320865c8e/users/fa98454857524eb8a6de7f5507049d50/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:15.102824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062201-7f97-4712-bd17-7e7dba2ee89c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:15.103420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062201-7f97-4712-bd17-7e7dba2ee89c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:15.103728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062201-7f97-4712-bd17-7e7dba2ee89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:15.133333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-32062201-7f97-4712-bd17-7e7dba2ee89c None None] MFA Rules not processed for user `fa98454857524eb8a6de7f5507049d50`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:15.134542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-32062201-7f97-4712-bd17-7e7dba2ee89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:15.199431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 964/1924] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:15.211291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:15.213031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:15.268480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479adf-4b29-4f0d-9be1-ba018908da00 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:15.272716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:15.273351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:15.273631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:15.273903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:15.281963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:15.283384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990ff57-8c67-4535-a95f-80bb878eea1e service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:15.292309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 961/1925] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:18.202100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:18.202606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:18.202686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:18.204375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 965/1926] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:06:18.258486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:18.259086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:18.259381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:18.323077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:18.324354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:18.503281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 962/1927] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:18.655772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:18.658071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:18.692355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ffda6-47a5-4c24-864d-3889f5c0d493 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:18.701807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:18.706788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:18.712407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:18.714078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:18.743120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:18.744932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbf4fb-eb78-4a87-be08-5745940ca0c8 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:18.760113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 966/1928] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:18.762752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:22.207740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:22.209350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:22.296291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57237-c781-453f-8e58-8cd2044dea7e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:22.304101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:22.304978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:22.305393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:22.305671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] PATH_INFO: `/v3/users/ac52cd9c3d7646f190235358a0f7eadf` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:22.306896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac52cd9c3d7646f190235358a0f7eadf)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:22.309404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:22.311901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:22.388987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac52cd9c3d7646f190235358a0f7eadf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.390118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac52cd9c3d7646f190235358a0f7eadf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.390941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac52cd9c3d7646f190235358a0f7eadf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.398620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac52cd9c3d7646f190235358a0f7eadf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.413438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac52cd9c3d7646f190235358a0f7eadf'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.425633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 963/1929] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:22 2022] DELETE /identity/v3/users/ac52cd9c3d7646f190235358a0f7eadf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:22.430621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:22.431080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:22.431169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:22.448179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:22.449371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:22.513102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 967/1930] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:22.522598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:22.524035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:22.579323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92e486-d0bb-4d6a-a602-d39c1b159b74 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:22.582983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:22.583648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:22.584492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:22.584770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:22.594086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:22.595560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:22.605695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 964/1931] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:22.863742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:22.865577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:22.879064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be18d06-8c33-4e54-b8a0-9ddacd397c5a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:22.883719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:22.884577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:22.884856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:22.885671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] PATH_INFO: `/v3/projects/d99877307e3845668b414648065aaf4e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:22.886867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99877307e3845668b414648065aaf4e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:22.888981 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:22.935662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99877307e3845668b414648065aaf4e', 'request_id': 'req-1bb81300-1959-4f45-94b2-c42459c53857'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.941532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99877307e3845668b414648065aaf4e', 'request_id': 'req-1bb81300-1959-4f45-94b2-c42459c53857'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.946948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99877307e3845668b414648065aaf4e', 'request_id': 'req-1bb81300-1959-4f45-94b2-c42459c53857'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.960336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] The token cache is being invalidate because project d99877307e3845668b414648065aaf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:22.960848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.961496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:22.963153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 968/1932] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:22 2022] DELETE /identity/v3/projects/d99877307e3845668b414648065aaf4e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:22.967244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:22.977702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed8641-492b-4aed-b513-fc9e08f89a97 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.034440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.035614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.035721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.036013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] PATH_INFO: `/v3/users/3573ee377bfc4b86a08e49444c44d2de` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.037207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3573ee377bfc4b86a08e49444c44d2de)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.039115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.066691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:23.087868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3573ee377bfc4b86a08e49444c44d2de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.088524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3573ee377bfc4b86a08e49444c44d2de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.089125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3573ee377bfc4b86a08e49444c44d2de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.097119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3573ee377bfc4b86a08e49444c44d2de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.108937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-acceecaf-1923-499c-b8df-ec56ebbafe29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3573ee377bfc4b86a08e49444c44d2de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.121236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 965/1933] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:22 2022] DELETE /identity/v3/users/3573ee377bfc4b86a08e49444c44d2de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:23.425463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.426865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:23.439808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb81300-1959-4f45-94b2-c42459c53857 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.501015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.501989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.502243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.502522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] PATH_INFO: `/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.503743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d473fee9cf144ac98c38e8a2da2c7c3)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.505772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.532072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:23.557517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d473fee9cf144ac98c38e8a2da2c7c3', 'request_id': 'req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.564711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d473fee9cf144ac98c38e8a2da2c7c3', 'request_id': 'req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.579717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d473fee9cf144ac98c38e8a2da2c7c3', 'request_id': 'req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.594542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] The token cache is being invalidate because project 1d473fee9cf144ac98c38e8a2da2c7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:23.594827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.595443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3f6b6356-6832-4ed1-a7c5-68c6fceb8721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:23.597217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 969/1934] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:23 2022] DELETE /identity/v3/projects/1d473fee9cf144ac98c38e8a2da2c7c3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:23.602419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.602910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.603003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.619927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:23.621119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:23.680686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 966/1935] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:23.689747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.690038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.690316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.715944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:23.717219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:23.725978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 970/1936] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:23.730782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.740968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b1b7-e118-4379-aca2-366a5ba0286b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.745581 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.746228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.746513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.746792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.747665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:23.747976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.749571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.760919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 967/1937] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:23.765096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.774257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9708a-0223-460d-80c3-a88f70182fa3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.778859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.779496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.779814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.780090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.780784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.782664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.807979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 971/1938] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:23 2022] POST /identity/v3/projects => generated 355 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:23.811914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.821896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671bf4a-0b4f-49b3-bb70-1d518a6d31d7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.876844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.877515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.877800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.878082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.878765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.880771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.900333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 968/1939] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:23 2022] POST /identity/v3/users => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:23.904417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.915108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f122-3cda-4ad5-859f-260f21bc0de6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.919735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.920378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.920661 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.920935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.921653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.923230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.933977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 972/1940] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:23.937798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.947574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efd47-61f2-401a-bdb2-4967c578e8a6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.952257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.952899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.953204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.953475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:23.954187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:23.955800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb707a0-bbd6-4c1d-9bfd-6e07875c91b6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:23.965747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 969/1941] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:23.969560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:23.980782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66a63d-e18d-4b8b-9441-da5b33c62880 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:23.986529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:23.987392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:23.987711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:23.987988 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] PATH_INFO: `/v3/projects/dede6c44cfdf4b08a1fee59b9ceb7bac/users/ea32150af174457eb3d4acf5583ace82/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.006321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dede6c44cfdf4b08a1fee59b9ceb7bac, user_id=ea32150af174457eb3d4acf5583ace82, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.009194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.022397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 973/1942] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:23 2022] PUT /identity/v3/projects/dede6c44cfdf4b08a1fee59b9ceb7bac/users/ea32150af174457eb3d4acf5583ace82/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:24.032545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.032837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.033118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.051328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:24.062301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] MFA Rules not processed for user `ea32150af174457eb3d4acf5583ace82`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:24.063686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:24.127287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 970/1943] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:24 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:24.131662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.193310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bcaf4-c2cb-44f8-94e9-93ca5a97a197 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.197903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.198545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.198827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.199102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.199829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.201698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.231413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 974/1944] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:24 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:24.232622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.243308 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf28dc-7f02-4ef6-8f5b-06908d2865b4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.301150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.301825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.302113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.302395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.303092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.305084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.325429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 971/1945] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:24 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:24.329416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.340566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bee6b-e425-4577-b454-02c10ae97465 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.345216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.346053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.346345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.346624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.347383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.349005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.360974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 975/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:24.365186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.375146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df74273-5c6e-4130-b4db-c6ed5ae9de37 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.379986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.380844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.381128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.381409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] PATH_INFO: `/v3/projects/be5a4da5279545c38be4dcfd49c44f5c/users/b068db2bffab464ea210e5c134863fc2/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.396162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5a4da5279545c38be4dcfd49c44f5c, user_id=b068db2bffab464ea210e5c134863fc2, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.399358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.413556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 972/1947] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:24 2022] PUT /identity/v3/projects/be5a4da5279545c38be4dcfd49c44f5c/users/b068db2bffab464ea210e5c134863fc2/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:24.417484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.428928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84970c-e890-4a2c-add6-cd08d2823c9e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.448145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:24.489946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.490836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.491124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.491538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.492283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.493892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d3f9f-8b19-4545-abb4-12b9972a2aa6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.507228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 976/1948] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:24.509094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.519410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0967-936f-4037-b344-1ab77e2bb929 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.524840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.525722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.526000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.526270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] PATH_INFO: `/v3/projects/be5a4da5279545c38be4dcfd49c44f5c/users/b068db2bffab464ea210e5c134863fc2/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.528341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5a4da5279545c38be4dcfd49c44f5c, user_id=b068db2bffab464ea210e5c134863fc2, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.531005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.541066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 973/1949] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:24 2022] PUT /identity/v3/projects/be5a4da5279545c38be4dcfd49c44f5c/users/b068db2bffab464ea210e5c134863fc2/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:24.550953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.551250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.551554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.577919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] MFA Rules not processed for user `b068db2bffab464ea210e5c134863fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:24.579258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:24.652801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 977/1950] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:24 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:24.664543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.666333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:24.728069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972e81f-703c-4e78-b9ee-9f7d14a04536 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.731765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.732444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.732725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.733001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.739041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:24.742965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.744960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c9539-8e28-4bfc-bb68-be4ee2a7eecc service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.755002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 974/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:24 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:24.824961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:24.835306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6644980-0571-4b61-823c-caa635faadd0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:24.838980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:24.839711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:24.840058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:24.840399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:24.898286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:24.899739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52101e4b-fdf9-4bce-a490-709f851cd2aa service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:24.908513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 978/1952] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:24 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:30.782933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:30.783395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:30.783523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:30.784876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 975/1953] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:06:30.792088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:30.792540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:30.792892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:30.817992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:30.819255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:30.884372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:30.916002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 979/1954] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:06:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:30.932440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:30.934164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:30.951727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc3b9-45a6-4d88-b762-da64f3205e89 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:30.957417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:30.958078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:30.958341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:30.958612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:30.968624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:30.970353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:30.981715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 976/1955] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:32.245774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:32.247779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:32.262260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477710d-0cb5-411d-86ac-b7a28d6d4724 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:32.266755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:32.267563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:32.267808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:32.268669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:32.270720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:32.382554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:32.384279 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b1697-5a27-4160-a726-d90bfda22169 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:32.399597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 980/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:37.540169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:37.541603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:37.654350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c5d7-d1bc-422f-b8fd-5375c7439ff5 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:37.670748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:37.671551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:37.671839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:37.672116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] PATH_INFO: `/v3/users/86cd08634e5f4b09b6b647877ff0104e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:37.675310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cd08634e5f4b09b6b647877ff0104e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:37.677455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:37.780074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cd08634e5f4b09b6b647877ff0104e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:37.783304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cd08634e5f4b09b6b647877ff0104e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:37.784080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cd08634e5f4b09b6b647877ff0104e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:37.807346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cd08634e5f4b09b6b647877ff0104e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:37.855029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cd08634e5f4b09b6b647877ff0104e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:37.881647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 977/1957] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:37 2022] DELETE /identity/v3/users/86cd08634e5f4b09b6b647877ff0104e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:37.883915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:37.884772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:37.885198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:37.907671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:37.909313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:37.978406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:37.985529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:38.029752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 981/1958] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:38.041140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:38.043435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:38.121912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987b3ff-4ed2-47e9-a8fb-fdf2bc911e2a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:38.127584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:38.128454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.128748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.129294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.141133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:38.143148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b5bf-64be-437b-826c-0cf75e2b8dc2 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:38.156079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 982/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:38.171882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364238f-1416-47ce-93cb-83a869722273 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:38.178573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:38.180043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.180585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.181008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] PATH_INFO: `/v3/users/e9a41a526dff4743abbc2be098fab0c3` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.183232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a41a526dff4743abbc2be098fab0c3)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:38.185543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:38.187620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:38.268649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a41a526dff4743abbc2be098fab0c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.269405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a41a526dff4743abbc2be098fab0c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.270121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a41a526dff4743abbc2be098fab0c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.294180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a41a526dff4743abbc2be098fab0c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.322583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a41a526dff4743abbc2be098fab0c3'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.352523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 978/1960] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:37 2022] DELETE /identity/v3/users/e9a41a526dff4743abbc2be098fab0c3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:38.358668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.358966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.359620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.392751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:38.394203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:38.400614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:38.486044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 983/1961] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:38.492911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:38.494999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:38.581518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495b79-0b09-4074-ba19-7ad67b3ba42c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:38.586264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:38.586992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.604324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.604324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.621249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:38.622714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:38.638762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 979/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:38.685297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:38.686980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:38.723034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d5411-b947-4a4e-ac55-752dfde2fd4a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:38.731412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:38.733116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.733383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.733715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] PATH_INFO: `/v3/projects/5af9282ad3d84609affd2b189a29be87` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.735253 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af9282ad3d84609affd2b189a29be87)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:38.737399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:38.796761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af9282ad3d84609affd2b189a29be87', 'request_id': 'req-24cf0640-3fed-434e-b71d-86bfdb63be3e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.808435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af9282ad3d84609affd2b189a29be87', 'request_id': 'req-24cf0640-3fed-434e-b71d-86bfdb63be3e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.814370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af9282ad3d84609affd2b189a29be87', 'request_id': 'req-24cf0640-3fed-434e-b71d-86bfdb63be3e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.830827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] The token cache is being invalidate because project 5af9282ad3d84609affd2b189a29be87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:38.831036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.831976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:38.834438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 984/1963] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:38 2022] DELETE /identity/v3/projects/5af9282ad3d84609affd2b189a29be87 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:38.839235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:38.848909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941e949-6057-4c2b-afff-b4b7a3495616 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:38.951235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:38.952274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:38.952635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:38.952932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] PATH_INFO: `/v3/users/edce3f3fdb80418ba0b83ba931f93222` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:38.954329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edce3f3fdb80418ba0b83ba931f93222)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:38.956459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:38.999995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:39.061903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:39.063443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:39.092735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edce3f3fdb80418ba0b83ba931f93222'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.098518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edce3f3fdb80418ba0b83ba931f93222'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.101184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edce3f3fdb80418ba0b83ba931f93222'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.112091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0640-3fed-434e-b71d-86bfdb63be3e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:39.119785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edce3f3fdb80418ba0b83ba931f93222'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.132477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:39.138801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.140059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.140536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] PATH_INFO: `/v3/projects/76dc8db98aaa4b878dd353f63923e36d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.143272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dc8db98aaa4b878dd353f63923e36d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:39.151706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:39.159211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edce3f3fdb80418ba0b83ba931f93222'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.189689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 980/1964] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:38 2022] DELETE /identity/v3/users/edce3f3fdb80418ba0b83ba931f93222 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:39.246466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dc8db98aaa4b878dd353f63923e36d', 'request_id': 'req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.254061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dc8db98aaa4b878dd353f63923e36d', 'request_id': 'req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.260087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dc8db98aaa4b878dd353f63923e36d', 'request_id': 'req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.274020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] The token cache is being invalidate because project 76dc8db98aaa4b878dd353f63923e36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:39.274312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.274942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.276668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 985/1965] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:39 2022] DELETE /identity/v3/projects/76dc8db98aaa4b878dd353f63923e36d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:39.280740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:39.282163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:39.362418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf57e-8645-48cc-84d2-31441e5275e3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:39.436358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:39.437356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.437747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.438091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] PATH_INFO: `/v3/users/b9886814007c459ca27df70faa403a2c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.440007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9886814007c459ca27df70faa403a2c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:39.442379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:39.494539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9886814007c459ca27df70faa403a2c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.495231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9886814007c459ca27df70faa403a2c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.495899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9886814007c459ca27df70faa403a2c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.498941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:39.517034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9886814007c459ca27df70faa403a2c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.539292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2cc1ba2-5a9b-491b-8c81-8a66f8168346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9886814007c459ca27df70faa403a2c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.539482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:39.542156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:39.557589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e27b-609f-42ba-a81a-9fbb66fcabd0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:39.564821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 981/1966] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:39 2022] DELETE /identity/v3/users/b9886814007c459ca27df70faa403a2c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:39.570917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:39.571639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.572037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.572327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] PATH_INFO: `/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.573647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd8b9ec07584118bb2d8c8eeaf17a78)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:39.576409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:39.594666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:39.658305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd8b9ec07584118bb2d8c8eeaf17a78', 'request_id': 'req-927c51ed-cab2-4121-bd2a-2bf42a2d587f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.665937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd8b9ec07584118bb2d8c8eeaf17a78', 'request_id': 'req-927c51ed-cab2-4121-bd2a-2bf42a2d587f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.674381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd8b9ec07584118bb2d8c8eeaf17a78', 'request_id': 'req-927c51ed-cab2-4121-bd2a-2bf42a2d587f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.690408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] The token cache is being invalidate because project 5fd8b9ec07584118bb2d8c8eeaf17a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:39.690829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.691562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-927c51ed-cab2-4121-bd2a-2bf42a2d587f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:39.697712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 986/1967] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:39 2022] DELETE /identity/v3/projects/5fd8b9ec07584118bb2d8c8eeaf17a78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:39.699368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.699895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.699995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.777375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:39.778847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:39.919882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 982/1968] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:39.927165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.927454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.927787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.951574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:39.952583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:39.970222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 987/1969] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:39.974187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:39.984759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53af33-a729-4622-a1c2-caf4a586a49e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:39.990575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:39.992463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:39.992755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:39.993037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:39.993951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:39.994271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:39.998290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.032459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 983/1970] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:40.034671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.050063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97a6e0-a798-47ac-a862-79c9d900e057 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.057125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.058992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.065907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.066866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.067154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.067433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.068284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.082628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.091282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a835496-b0c1-43c6-8001-414916b8070d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.097280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.098037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.098320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.098597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] PATH_INFO: `/v3/projects/ac3974772856444e864d5622425241d9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.101603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3974772856444e864d5622425241d9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.103726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.148099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 988/1971] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:40.149293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.151486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.176759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3974772856444e864d5622425241d9', 'request_id': 'req-352c4c43-7c26-4f1b-b406-ab1acf63f859'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.192934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3974772856444e864d5622425241d9', 'request_id': 'req-352c4c43-7c26-4f1b-b406-ab1acf63f859'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.200887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3974772856444e864d5622425241d9', 'request_id': 'req-352c4c43-7c26-4f1b-b406-ab1acf63f859'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.217317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] The token cache is being invalidate because project ac3974772856444e864d5622425241d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:40.217701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.218600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.220616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 984/1972] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:40 2022] DELETE /identity/v3/projects/ac3974772856444e864d5622425241d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:40.221526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.224798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.264557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c243-48e8-461e-8716-4309e4308a27 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.283655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:40.316809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c4c43-7c26-4f1b-b406-ab1acf63f859 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.323025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.324422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.324780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.325130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.325970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.328757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a21927-f632-4a5d-a382-be7bd855415a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.352096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.354013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.354846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.355607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] PATH_INFO: `/v3/users/a4cc20334d2e4e7eb7c29636f46efd04` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.357087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cc20334d2e4e7eb7c29636f46efd04)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.359210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.365926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 985/1973] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:40.370396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.370675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.370948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.388618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:40.394334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:40.395828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.414078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 986/1974] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:40.414078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.421203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfa32a-0b2b-43be-9dbd-967f204f5e84 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.428834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.430500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.430743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.431128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.431981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.433572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba43e91-4667-45aa-9a77-f009c0955c00 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.448309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 987/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:40.449684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.449991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.450453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.452545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cc20334d2e4e7eb7c29636f46efd04'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.472064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:40.474825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.481642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cc20334d2e4e7eb7c29636f46efd04'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.482885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cc20334d2e4e7eb7c29636f46efd04'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.483705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cc20334d2e4e7eb7c29636f46efd04'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.484710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 988/1976] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:40.485698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.493871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cc20334d2e4e7eb7c29636f46efd04'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:40.500882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4d59b-2e2d-4803-ab70-389d30526e4d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.505738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.506399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.506703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.506972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.508266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.509841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a0bdb-b7cd-43b2-8f05-bed2a2f546cc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.522288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 989/1977] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:40 2022] DELETE /identity/v3/users/a4cc20334d2e4e7eb7c29636f46efd04 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:40.522288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.522288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.528893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 989/1978] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:40.530699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.530989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.531288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.558098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:40.559705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.598621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccd38-83d6-45c8-8275-66abe6d2c11c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.604218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.604899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.605226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.605486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.606358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:40.606673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.608740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.629716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 990/1979] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:40.630686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.632397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.637957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 990/1980] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:40.639284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.651816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836056c6-a5ca-4b7a-9bf8-b0b76966a818 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.658270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.658936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.659221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.659496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.660222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.662139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.669427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8c3c-3a13-428e-a169-54ae5cf1fe2d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.675315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.676597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.677034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.677591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] PATH_INFO: `/v3/projects/7d8fcc242c934d4680270e8d834d9b05/users/10dfba1b0e2a453dbbdf24986376f063/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.694314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 991/1981] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:40.696585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.697844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.699218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8fcc242c934d4680270e8d834d9b05, user_id=10dfba1b0e2a453dbbdf24986376f063, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.702917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.717011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 991/1982] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:40 2022] PUT /identity/v3/projects/7d8fcc242c934d4680270e8d834d9b05/users/10dfba1b0e2a453dbbdf24986376f063/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:40.726327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.770639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d6d4e-97e3-4ee8-888d-a0dae8eb32df admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.798165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:40.800723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af87437-26b0-4c14-91c1-38487ec962ee admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.806088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.806838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.807117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.807528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.808200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.810431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c5b79-0350-4926-82a1-2c8c56309059 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.830746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:40.835146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.836108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.836514 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.836898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.839705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 992/1983] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/users => generated 305 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:40.842244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.842904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.846850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.849496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.851051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.863057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 992/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:40.863899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.880113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c537c7-2d79-44f3-afa3-5c71e31ea9d4 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.885807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] MFA Rules not processed for user `10dfba1b0e2a453dbbdf24986376f063`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:40.887043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:40.887337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.888272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.888739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.889398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.890562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.892920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.906509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 993/1985] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:40.910662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.923982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7996-0cbe-4181-8780-6fb35c8bcaf4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.932578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.933720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.934077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.934456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.935611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:40.938553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:40.952599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 994/1986] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:40.956753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:40.968554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1319-77ca-412a-a32e-92c4c2c349aa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:40.975320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:40.977489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:40.977901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:40.978230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] PATH_INFO: `/v3/projects/d0f15743943e4cbdae13b2080d10810e/users/cd93276ba938439a91ae32216818258f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:40.979135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 993/1987] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:40.980099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.004959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd702f-2f67-4814-9018-52293e8c9d1b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.006811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f15743943e4cbdae13b2080d10810e, user_id=cd93276ba938439a91ae32216818258f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.011022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6c98-3730-4c15-a4e4-03a61be5f595 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.011370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.012444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.012947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.013425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.014660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.017072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.045043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 995/1988] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:40 2022] PUT /identity/v3/projects/d0f15743943e4cbdae13b2080d10810e/users/cd93276ba938439a91ae32216818258f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:41.056142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.066350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 994/1989] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:40 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:41.066812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.066812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.070102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.139736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] MFA Rules not processed for user `cd93276ba938439a91ae32216818258f`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:41.141492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.184482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2e60-baf5-476e-9b91-d320cecdd2a6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.191126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.191841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.192128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.192411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.193269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.196235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.240341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 995/1990] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:41 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:41.244523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.265998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6b38-b09c-4861-a01d-6f9e9b556f6e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.280444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.281134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.291814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.291814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.291814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.291814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.304306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 996/1991] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:41.307281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.319853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 996/1992] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:41.323950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.324752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2bdac-7da5-4e3a-9518-6b431e915d16 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.342038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.342759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.343024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.343299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.344033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.344214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a07b-54cb-4ac4-9410-c37d6977691e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.345953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.350570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.352351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.352645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.353566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] PATH_INFO: `/v3/projects/d76ed3664272435bb96dbd91644c3172/users/9798cd99fe3b4feba32745d9f3689eed/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.374161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76ed3664272435bb96dbd91644c3172, user_id=9798cd99fe3b4feba32745d9f3689eed, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.386507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.398622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 997/1993] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:41 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:41.399529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.439099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 997/1994] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:41 2022] PUT /identity/v3/projects/d76ed3664272435bb96dbd91644c3172/users/9798cd99fe3b4feba32745d9f3689eed/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:41.443217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.468617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:41.519074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:41.540579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c754-91d3-4905-9cf9-1e60deee6903 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.551376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.551769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267275d1-c4a2-4684-ae10-1cd8494fc635 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.552156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.552390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.552676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.553375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.555344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.557441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.558218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.558500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.559415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.560248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.561982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.578612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 998/1995] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:41.581033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.583384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.592958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 998/1996] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:41 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:41.597920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.605987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02841fc1-6383-4d6f-940a-c33930a3e9ce admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.609817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ba5cf-e68f-476b-8edc-2458e29912fe admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.612186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.613071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.613353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.613711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] PATH_INFO: `/v3/projects/a0bd0f48e8d247dc94b384cdff9fd77d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.614927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bd0f48e8d247dc94b384cdff9fd77d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.615039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.616003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.616289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.616563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] PATH_INFO: `/v3/projects/d76ed3664272435bb96dbd91644c3172/users/9798cd99fe3b4feba32745d9f3689eed/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.616860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.618750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76ed3664272435bb96dbd91644c3172, user_id=9798cd99fe3b4feba32745d9f3689eed, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.621506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.634264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 999/1997] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:41 2022] PUT /identity/v3/projects/d76ed3664272435bb96dbd91644c3172/users/9798cd99fe3b4feba32745d9f3689eed/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:41.636386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.678229 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bd0f48e8d247dc94b384cdff9fd77d', 'request_id': 'req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.684785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bd0f48e8d247dc94b384cdff9fd77d', 'request_id': 'req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.691522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bd0f48e8d247dc94b384cdff9fd77d', 'request_id': 'req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.713733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] The token cache is being invalidate because project a0bd0f48e8d247dc94b384cdff9fd77d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:41.714054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.715032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8d27adda-62c4-45fe-8cf3-1d54c60e9c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.718252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 999/1998] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:41 2022] DELETE /identity/v3/projects/a0bd0f48e8d247dc94b384cdff9fd77d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:41.720705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.720970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.721316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.739193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f79ea-0f88-4c63-962b-ff2d79498484 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.768721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] MFA Rules not processed for user `9798cd99fe3b4feba32745d9f3689eed`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:41.770447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.848355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.849204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.849477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.849753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.850486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.852164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.863293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1000/1999] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:41.864169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.866678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.871493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1000/2000] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:41.871493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.871493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.880153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1804a3-b0ef-48df-bce9-1806434842d7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.884851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecb137-f54d-4336-8935-c953d8194b6b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:41.885916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.886810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.887153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.887367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] PATH_INFO: `/v3/users/520cd86f673a425a956c726fa1e77cf1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.888595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=520cd86f673a425a956c726fa1e77cf1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.890203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:41.890545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.891271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:41.891648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:41.891929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] PATH_INFO: `/v3/projects/87f2c5a883d744158454d5450c43ea78/users/7a289d4e0ddf4b04a9d522657a65533d/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:41.911252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f2c5a883d744158454d5450c43ea78, user_id=7a289d4e0ddf4b04a9d522657a65533d, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:41.914699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:41.926738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:41.934699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1001/2001] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:41 2022] PUT /identity/v3/projects/87f2c5a883d744158454d5450c43ea78/users/7a289d4e0ddf4b04a9d522657a65533d/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:41.936045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:41.939606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:41.964605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520cd86f673a425a956c726fa1e77cf1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.965953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520cd86f673a425a956c726fa1e77cf1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.966652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520cd86f673a425a956c726fa1e77cf1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.977395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520cd86f673a425a956c726fa1e77cf1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:41.990239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:41.999217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520cd86f673a425a956c726fa1e77cf1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.015963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1001/2002] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:41 2022] DELETE /identity/v3/users/520cd86f673a425a956c726fa1e77cf1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:42.016832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.018163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.026166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f79246-f628-4b99-87b3-51656f153428 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.102299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.103123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.103368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.103683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.105709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.119424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e641-4ce6-47ae-8041-11ef8323ddaf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.125595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.126378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.127151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.127444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.128215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.131151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.144885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1002/2003] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:42.148967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.160502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11018d1-c07e-4228-8b5b-5bfe9157d03c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.168495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.169874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.170161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.170980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] PATH_INFO: `/v3/projects/87f2c5a883d744158454d5450c43ea78/users/7a289d4e0ddf4b04a9d522657a65533d/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.173639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f2c5a883d744158454d5450c43ea78, user_id=7a289d4e0ddf4b04a9d522657a65533d, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.177370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.177512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5726588-1268-4457-b294-b1deae385b20 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.179188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.203314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1003/2004] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:42 2022] PUT /identity/v3/projects/87f2c5a883d744158454d5450c43ea78/users/7a289d4e0ddf4b04a9d522657a65533d/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:42.207062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1002/2005] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:42.221124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.221728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.222513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.266691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] MFA Rules not processed for user `7a289d4e0ddf4b04a9d522657a65533d`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:42.268001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.339340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.340142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.365112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa84fe8-f469-474e-bb15-c341ce1a9af0 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.391626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1004/2006] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:42.399792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.402522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.464087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.464846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.465208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.465623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.468080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.475258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361ee21-c34d-4b56-aa7d-0dddf8becab6 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.483095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.484615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.484902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.485230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.495660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:42.500996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.502596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.503800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:42.522853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1005/2007] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:42.523947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.525341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.600711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.604322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f86abc-e000-4d65-945c-75d7b055627a service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.645330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1003/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:42.708879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2468f3-70be-4f89-bc5f-0878c94f142a service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:42.719142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:42.720134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.720488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.720891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] PATH_INFO: `/v3/projects/7620a49bb31e45779c0e966d6f330656` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.727492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7620a49bb31e45779c0e966d6f330656)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:42.733876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:42.831994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7620a49bb31e45779c0e966d6f330656', 'request_id': 'req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.842153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7620a49bb31e45779c0e966d6f330656', 'request_id': 'req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.852603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7620a49bb31e45779c0e966d6f330656', 'request_id': 'req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.868944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] The token cache is being invalidate because project 7620a49bb31e45779c0e966d6f330656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:42.869289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.869963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:42.872826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1006/2009] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:42 2022] DELETE /identity/v3/projects/7620a49bb31e45779c0e966d6f330656 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:42.878329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6ea-ac00-41e2-aa7a-d169b81af001 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:42.878657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6ea-ac00-41e2-aa7a-d169b81af001 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:42.878898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb6ea-ac00-41e2-aa7a-d169b81af001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:42.933899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-792bb6ea-ac00-41e2-aa7a-d169b81af001 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:42.936409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-792bb6ea-ac00-41e2-aa7a-d169b81af001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:42.941496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:42.943088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:43.033489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29636f-07ca-42d5-a0a7-40cc1f2b26de admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.044907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.045660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.049967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.050363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.053974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:43.113272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1004/2010] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:43.121886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.122233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.122555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.156831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:43.161023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:43.166190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:43.200569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1005/2011] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:43.205057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.206651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.218050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.230499 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5054e1-928c-4b78-8758-c572232283e4 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.247408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.248170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.248461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.248735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.249484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:43.249795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.251212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1007/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:43.260149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.300813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1006/2013] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:43.305282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.322460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b070f0f-7d6a-4835-8885-0c086e1f42b2 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.332377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.335193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.336106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.337549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.338293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.345965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.407778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1008/2014] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:43 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:43.420618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.435049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fccfa-aa51-410e-b002-a5c6575de851 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.611621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.613907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.615464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.617678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.620870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.632023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.689161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1007/2015] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:43 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:43.692299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.709462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e994dd-ed77-4070-a662-54f6239c4834 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.727601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.728512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.729836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.730297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.731211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.751610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.784771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1009/2016] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:43.789698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.808062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eeb2e-2042-493a-8a46-4bcbf78cc629 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.813710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.814382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.814675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.814990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.815766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.817437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.837235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1008/2017] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:43.838249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.851545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff0aa-a385-4b88-a6f0-c844cf305b40 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.870602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.873375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.873890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.874353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] PATH_INFO: `/v3/projects/55aeeb05351f4b0c8534ef14025a29e1/users/ddbd2b13d2664a9db111f0a00a947124/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.922712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:43.924535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:43.940042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55aeeb05351f4b0c8534ef14025a29e1, user_id=ddbd2b13d2664a9db111f0a00a947124, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.942725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574a37f-eefb-460c-b8c9-9c4566597a1d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.955691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b06832-805e-49e3-86bd-828bcd790930 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:43.973707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:43.975600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:43.975910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:43.981986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] PATH_INFO: `/v3/users/fa98454857524eb8a6de7f5507049d50` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:43.986300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa98454857524eb8a6de7f5507049d50)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:43.988298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:43.993351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1010/2018] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:43 2022] PUT /identity/v3/projects/55aeeb05351f4b0c8534ef14025a29e1/users/ddbd2b13d2664a9db111f0a00a947124/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:44.010832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.011123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.011404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.048663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:44.076092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] MFA Rules not processed for user `ddbd2b13d2664a9db111f0a00a947124`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:44.077601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:44.120294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa98454857524eb8a6de7f5507049d50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:44.155327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa98454857524eb8a6de7f5507049d50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:44.156174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa98454857524eb8a6de7f5507049d50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:44.157816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa98454857524eb8a6de7f5507049d50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:44.174573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-730b6cb9-3fad-41f9-b5f3-fb5491135d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa98454857524eb8a6de7f5507049d50'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:44.216381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1009/2019] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:43 2022] DELETE /identity/v3/users/fa98454857524eb8a6de7f5507049d50 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:44.220236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.220538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.220823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.255204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:44.257006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:44.281143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1011/2020] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:44.282066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.287546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:44.361936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1010/2021] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:44.386991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.389367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:44.393286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d78a4-ddcc-4a72-a87b-79a21a61d595 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.401121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.402075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.402549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.402988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.403991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.406360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.442411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:44.464556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1012/2022] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:44.470312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.544042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb588eb-6eca-440d-87e9-6bad54fac974 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.554877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e301ac-4ad0-458a-846d-434dd0d518ea admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.563611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.564297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.564585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.565100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.566156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.568811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.606109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1013/2023] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:44.607216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.631402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555b70b-029b-4cee-91e3-b1155a8c7805 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.646724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.647523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.647894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.648242 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.649682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.652060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.660801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:44.671046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.672146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.672357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.673785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.678740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1014/2024] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:44.683316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.699541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.702057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.705895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272f78-7cce-49fd-8159-8d36a0617235 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.713377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.714198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.714609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.714895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.715661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.717285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178aeb6-5511-44a6-a941-93a9cec27375 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.717539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1011/2025] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:44.745121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:44.745349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1015/2026] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:44.757169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10b31-538b-404b-9161-9db29a384f60 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:44.762580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:44.763608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.764128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.764616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] PATH_INFO: `/v3/projects/22362441515646c09fd48ce2b4c115b5/users/67a98127accd4104bec1a2f62451fbd2/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.786025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22362441515646c09fd48ce2b4c115b5, user_id=67a98127accd4104bec1a2f62451fbd2, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:44.790627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:44.814268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1012/2027] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:44 2022] PUT /identity/v3/projects/22362441515646c09fd48ce2b4c115b5/users/67a98127accd4104bec1a2f62451fbd2/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:44.825998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0478c-455c-4690-9090-23338fab77fd None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:44.826403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0478c-455c-4690-9090-23338fab77fd None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:44.826610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0478c-455c-4690-9090-23338fab77fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:44.858943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-27c0478c-455c-4690-9090-23338fab77fd None None] MFA Rules not processed for user `67a98127accd4104bec1a2f62451fbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:44.860617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-27c0478c-455c-4690-9090-23338fab77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:44.963896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1016/2028] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:44.966895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.144098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8407-66fb-4a24-b2d1-b3dc227b9b0b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.151092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.152343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.152764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.153524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.165733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.170902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.252451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1013/2029] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:44 2022] POST /identity/v3/projects => generated 385 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:45.256991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0478c-455c-4690-9090-23338fab77fd None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.303578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.305154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0478c-455c-4690-9090-23338fab77fd None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.305751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:45.407187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:45.428035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.429837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.429837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.429837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.430070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.431981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.455605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677d293-ae41-4d22-831b-715645507e19 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.456702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1017/2030] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:45 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:45.461476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.462482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.463470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.464161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.464538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] PATH_INFO: `/v3/projects/c5fb00f72c1347fe9b5b9a6320865c8e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.465835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fb00f72c1347fe9b5b9a6320865c8e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.468547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.474205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23b5ae-a1e7-40f7-9be5-d078a32a2587 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.478979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.479768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.480058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.480449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.481084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.482847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.495669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1018/2031] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:45.500833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.512113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9c72-db84-476c-9751-09418e99b4e4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.520768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.521714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.522125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.522368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] PATH_INFO: `/v3/projects/33e60d2afad84e13816a03d54a745367/users/96453f140fc84cf4bd977efd81c46885/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.537503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fb00f72c1347fe9b5b9a6320865c8e', 'request_id': 'req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:45.545936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fb00f72c1347fe9b5b9a6320865c8e', 'request_id': 'req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:45.548126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:45.556475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fb00f72c1347fe9b5b9a6320865c8e', 'request_id': 'req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:45.568582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e60d2afad84e13816a03d54a745367, user_id=96453f140fc84cf4bd977efd81c46885, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.581353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.583764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] The token cache is being invalidate because project c5fb00f72c1347fe9b5b9a6320865c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:45.584341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:45.586087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-a28bd4f6-0dad-4a69-9aa1-55ed239a419f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:45.589441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1014/2032] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:45 2022] DELETE /identity/v3/projects/c5fb00f72c1347fe9b5b9a6320865c8e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:45.598325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6618-0495-473b-98f3-ceb4d9f6a253 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.598929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6618-0495-473b-98f3-ceb4d9f6a253 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.599546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6618-0495-473b-98f3-ceb4d9f6a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.619020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1019/2033] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:45 2022] PUT /identity/v3/projects/33e60d2afad84e13816a03d54a745367/users/96453f140fc84cf4bd977efd81c46885/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:45.622567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.627255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f46d6618-0495-473b-98f3-ceb4d9f6a253 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:45.628643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:45.629654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f46d6618-0495-473b-98f3-ceb4d9f6a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:45.765990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1015/2034] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:45.773530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.773927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.774217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.787178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368477ae-e2c4-4647-b867-5186089795ec admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.799802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.800461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.800742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.801013 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.801869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.803496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.814328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:45.815641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:45.819701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1020/2035] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:45.824056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.834337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1016/2036] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:45.836393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63959e-5b88-43ce-8a00-137a84a1ecce admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.839922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.841573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.842460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.842737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.843009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] PATH_INFO: `/v3/projects/33e60d2afad84e13816a03d54a745367/users/96453f140fc84cf4bd977efd81c46885/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.845255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e60d2afad84e13816a03d54a745367, user_id=96453f140fc84cf4bd977efd81c46885, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.848406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e645a-8a6c-4a61-a99f-f35e2c88f445 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.857248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a365d8e-7f9e-4df0-a863-c19d15ceb1c9 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.867591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1021/2037] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:45 2022] PUT /identity/v3/projects/33e60d2afad84e13816a03d54a745367/users/96453f140fc84cf4bd977efd81c46885/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:45.881895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.882257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.883059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.913731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] MFA Rules not processed for user `96453f140fc84cf4bd977efd81c46885`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:45.914906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:45.938907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.939205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.939356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.939668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.940401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:45.940707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.942420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:45.959986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1017/2038] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:45.962294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:45.978082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2566-c33e-4e29-821f-1b64111198b3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:45.988910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:45.989593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:45.989861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:45.990134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:45.990831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:45.996252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.022385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1022/2039] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:46.036877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.039325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.042161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1018/2040] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:45 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:46.046407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.062821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:46.116448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcf3e-3267-448a-9387-6ae811cafdc1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.126429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:46.152509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ffc4d-06e1-4175-930e-1b82b42e906c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.158905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.160361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.160361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.160590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.161144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.163235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.183479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.184343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.184720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.185155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.187224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.187609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1019/2041] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:46 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:46.191543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.213993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33203b73-dd8d-4ecc-9c32-c94744f83c8a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.229213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.229374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.229763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.230044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.230762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.238430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.258655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1020/2042] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:46.258655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.272394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777effa-6e52-4a69-84cd-524384a33fd0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.283620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.284254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.285277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.285574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.286072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.286329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.287970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.288189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.300806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1023/2043] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:46.303930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1021/2044] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:46.308371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.321771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dbe69-e0ae-476a-9767-2e62949bf951 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.326869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.327874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.328355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.328711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] PATH_INFO: `/v3/projects/bf6655740c8f4049ae3338a298cc1d3b/users/f6698c1613af4d218875192c98ea3e31/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.346385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6655740c8f4049ae3338a298cc1d3b, user_id=f6698c1613af4d218875192c98ea3e31, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.349839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f846f-4797-4023-ac69-408b20030ee4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.371215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1024/2045] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:46 2022] PUT /identity/v3/projects/bf6655740c8f4049ae3338a298cc1d3b/users/f6698c1613af4d218875192c98ea3e31/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:46.372944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.374689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.381156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.381847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.382534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.394043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c7e7d-695b-484f-b8a0-944ef9a046b5 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.424062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] MFA Rules not processed for user `f6698c1613af4d218875192c98ea3e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:46.425421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.472584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.473523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.473809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.474088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] PATH_INFO: `/v3/users/10dfba1b0e2a453dbbdf24986376f063` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.475404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10dfba1b0e2a453dbbdf24986376f063)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.478019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.502009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:46.529977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1025/2046] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:46.542662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.544712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.548855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10dfba1b0e2a453dbbdf24986376f063'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:46.568014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10dfba1b0e2a453dbbdf24986376f063'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:46.569311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10dfba1b0e2a453dbbdf24986376f063'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:46.570735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10dfba1b0e2a453dbbdf24986376f063'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:46.583082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c265b127-a4ff-4021-9bbb-5faf377211a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10dfba1b0e2a453dbbdf24986376f063'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:46.610179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1022/2047] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:46 2022] DELETE /identity/v3/users/10dfba1b0e2a453dbbdf24986376f063 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:46.612884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.613181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.613460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.615748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46261c91-4c77-4897-b06b-cf5bf0e9058a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.641322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:46.642753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.685039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:46.713066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.713739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.714017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.714340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.717915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.736060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1023/2048] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:46.749613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:46.751194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:46.818288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5cba0-0f2a-4318-b70c-89bb2e487e19 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:46.822424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.822869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:46.823549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:46.823845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:46.823967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.824133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:46.833333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1026/2049] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:46.833620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:46.837522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:46.849187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1024/2050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:47.169782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:47.171355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:47.190972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4c83-7aa5-40ff-a61b-7dced241d6e0 service glance] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:47.196670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:47.197570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:47.197952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:47.198211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] PATH_INFO: `/v3/projects/7d8fcc242c934d4680270e8d834d9b05` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:47.199522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8fcc242c934d4680270e8d834d9b05)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:47.202021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:47.265247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8fcc242c934d4680270e8d834d9b05', 'request_id': 'req-06ba6cbc-00b0-48e2-9810-d9f917f35387'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.274262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8fcc242c934d4680270e8d834d9b05', 'request_id': 'req-06ba6cbc-00b0-48e2-9810-d9f917f35387'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.277639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:47.288087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8fcc242c934d4680270e8d834d9b05', 'request_id': 'req-06ba6cbc-00b0-48e2-9810-d9f917f35387'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.307659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] The token cache is being invalidate because project 7d8fcc242c934d4680270e8d834d9b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:47.308075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.308953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.311654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1027/2051] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:47 2022] DELETE /identity/v3/projects/7d8fcc242c934d4680270e8d834d9b05 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:47.324760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:47.326649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b7ecf-f782-4054-a9f5-b54d702c48f0 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:47.409456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:47.410345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:47.410633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:47.410990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] PATH_INFO: `/v3/users/9798cd99fe3b4feba32745d9f3689eed` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:47.412141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9798cd99fe3b4feba32745d9f3689eed)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:47.414191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:47.473664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9798cd99fe3b4feba32745d9f3689eed'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.485597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9798cd99fe3b4feba32745d9f3689eed'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.486274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9798cd99fe3b4feba32745d9f3689eed'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.488650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9798cd99fe3b4feba32745d9f3689eed'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.496473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-12c099ec-4c78-46c1-a9bd-d94415e0b73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9798cd99fe3b4feba32745d9f3689eed'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.504460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:47.510881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1025/2052] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:47 2022] DELETE /identity/v3/users/9798cd99fe3b4feba32745d9f3689eed => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:47.804924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:47.806411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:47.821876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6cbc-00b0-48e2-9810-d9f917f35387 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:47.887200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:47.888371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:47.888650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:47.888921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] PATH_INFO: `/v3/projects/d76ed3664272435bb96dbd91644c3172` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:47.890096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76ed3664272435bb96dbd91644c3172)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:47.892288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:47.944163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76ed3664272435bb96dbd91644c3172', 'request_id': 'req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.952563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76ed3664272435bb96dbd91644c3172', 'request_id': 'req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.958345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76ed3664272435bb96dbd91644c3172', 'request_id': 'req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.975584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] The token cache is being invalidate because project d76ed3664272435bb96dbd91644c3172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:47.975584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.975584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fbe5275a-a1cc-4dce-8d24-b0279b7e7942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:47.975584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1028/2053] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:47 2022] DELETE /identity/v3/projects/d76ed3664272435bb96dbd91644c3172 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:47.979266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:47.979680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:47.980046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:47.999428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:48.000762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:48.065817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1026/2054] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:48.074582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.075071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.075582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.095275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:48.096737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:48.106906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1029/2055] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:48.111126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.121391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b232-b00b-4f03-8a3b-9d134beb830d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.126683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.127701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.128008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.128137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.128804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:48.129198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.131002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.143305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1027/2056] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:06:48.147612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.156611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eab5a-5993-480b-967c-54203d8a4296 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.161225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.161851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.162154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.162427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.163108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.165054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.190065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1030/2057] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:48.194091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.204648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0b579-5a2f-43ce-8e51-a947ba54b737 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.262678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.263338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.263666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.263942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.264640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.266583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.289947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1028/2058] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:48.291257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.301495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4f78-940e-4dbd-b03a-a5a2274682d3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.307187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.307868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.308148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.308418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.309136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.310729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.321635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1031/2059] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:48.325646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.336171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed58fc9-dc2e-460f-a1f6-7713b4cbba47 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.340802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.341447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.341732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.342009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.342895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.344594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e2ff-6ca5-487c-9d63-3a491a5b39e8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.354679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1029/2060] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:48.358751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.369105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e717-3c34-44b2-b829-e59dfbd9ce54 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.373771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.374631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.374915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.375194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] PATH_INFO: `/v3/projects/16c3f3d3f30b4086be5d579f3d65b4c4/users/e9332cffa9ba44a3b7deb333ab670625/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.390251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c3f3d3f30b4086be5d579f3d65b4c4, user_id=e9332cffa9ba44a3b7deb333ab670625, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.393616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.422063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1032/2061] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:48 2022] PUT /identity/v3/projects/16c3f3d3f30b4086be5d579f3d65b4c4/users/e9332cffa9ba44a3b7deb333ab670625/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:48.424014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.424323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.425064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.456851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] MFA Rules not processed for user `e9332cffa9ba44a3b7deb333ab670625`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:48.458043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:48.520275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:48.535808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1030/2062] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:48.539789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.556165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:48.607247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb261a0-b390-4551-bf1d-765c65df4c23 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.611905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.612548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.612834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.613108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.613886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.615826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.644044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1033/2063] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:48.648241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.660026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baab97-8b0b-45af-9e5d-2d5af07f4cfe None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.738841 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.739565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.739854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.740133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.740838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.743308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.766039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1031/2064] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:48.770105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.781194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fc7b-10aa-4502-bb03-04a2648332bf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.787392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.788210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.789311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.789595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.790336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.792132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.804167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1034/2065] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:48.808247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.818779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2882d-394a-47e8-8edf-8bd293d028c0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.824896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.825568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.825856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.826133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.826865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.828566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240edd5a-208f-4557-b5ca-bbb947df275f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.839788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1032/2066] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:48.844280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.855493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f091-ed71-4e8d-81ec-aea2fc6a6636 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:48.860901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:48.861912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.862294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.862482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] PATH_INFO: `/v3/projects/b02711301264489cb3011458a8a9900b/users/335710a0e31c4aa696a79e04d07e4612/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.882265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02711301264489cb3011458a8a9900b, user_id=335710a0e31c4aa696a79e04d07e4612, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:48.885041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:48.898924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1035/2067] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:48 2022] PUT /identity/v3/projects/b02711301264489cb3011458a8a9900b/users/335710a0e31c4aa696a79e04d07e4612/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:48.910079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:48.910375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:48.910703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:48.940634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] MFA Rules not processed for user `335710a0e31c4aa696a79e04d07e4612`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:48.941879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:48.971142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:48.973194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:49.036755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1033/2068] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:49.037790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.048318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874c0f-f76f-46ed-8941-9ba30304f3c8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.052345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.053207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.053562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.053845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.055818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:49.129053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876452f-5898-4a82-833f-9bcb3b6853db None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.135111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.135799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.136085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.136402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.137083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.139005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.142719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.143847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:49.144234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.154409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1036/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:49.170365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1034/2070] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:49 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:49.174690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.188465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241a25-f8a3-4376-a2c5-c7098cfadd22 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.203537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:49.263414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.264111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.264430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.264753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.265537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.267530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.292576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1037/2071] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:49 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:49.297040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.313564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f4682-e261-4763-a8f0-db1e2d28913d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.319078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.320288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.320585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.321015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.322219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.324064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.336724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1035/2072] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:49.341239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.355370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe86f3-e10a-401d-95f3-b22bb48b7c02 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.365295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.366093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.366402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.367222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] PATH_INFO: `/v3/projects/2494571d18cf4977b5d2372db1182ae9/users/33875ad3363a4ba689223321eeab47ac/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.389752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2494571d18cf4977b5d2372db1182ae9, user_id=33875ad3363a4ba689223321eeab47ac, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.394188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.409959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1038/2073] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:49 2022] PUT /identity/v3/projects/2494571d18cf4977b5d2372db1182ae9/users/33875ad3363a4ba689223321eeab47ac/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:49.414364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.425443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005658b-8e34-4579-9d72-600d35cab493 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.490273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.491126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.491468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.492298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.493084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.494829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d149c-dc0c-4b2f-beb7-d67e45ce0502 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.505684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1036/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:49.516205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.547924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c251bf3-3c65-46c4-b193-2b6aae7fd6d3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.558179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.559770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.560087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.560347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] PATH_INFO: `/v3/projects/2494571d18cf4977b5d2372db1182ae9/users/33875ad3363a4ba689223321eeab47ac/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.562424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2494571d18cf4977b5d2372db1182ae9, user_id=33875ad3363a4ba689223321eeab47ac, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.566723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.591576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1039/2075] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:49 2022] PUT /identity/v3/projects/2494571d18cf4977b5d2372db1182ae9/users/33875ad3363a4ba689223321eeab47ac/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:49.593523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423789be-e684-4296-9261-289a352fd08e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.593872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423789be-e684-4296-9261-289a352fd08e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.594166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423789be-e684-4296-9261-289a352fd08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.652102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-423789be-e684-4296-9261-289a352fd08e None None] MFA Rules not processed for user `33875ad3363a4ba689223321eeab47ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:49.654314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-423789be-e684-4296-9261-289a352fd08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:49.776419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1037/2076] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:49.790872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.831191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423789be-e684-4296-9261-289a352fd08e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:49.832734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-423789be-e684-4296-9261-289a352fd08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:49.851911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27a4bb-69b6-4246-921c-e89e90995258 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.855806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.856547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.856893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.857333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.866752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.868281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:49.877890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1040/2077] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:49.897260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423789be-e684-4296-9261-289a352fd08e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:49.901554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:49.902194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:49.902477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:49.902754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:49.904552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:49.936554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:49.990265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:49.992254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:50.006393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1038/2078] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:50.621224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:50.622707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:50.698343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c18c7-f57a-4896-9ef7-90cc201ccbb9 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:50.705455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:50.706722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:50.707167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:50.708406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] PATH_INFO: `/v3/users/ea32150af174457eb3d4acf5583ace82` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:50.711141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea32150af174457eb3d4acf5583ace82)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:50.713237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:50.730334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:50.769809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea32150af174457eb3d4acf5583ace82'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:50.770614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea32150af174457eb3d4acf5583ace82'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:50.771254 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea32150af174457eb3d4acf5583ace82'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:50.774936 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:50.780330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea32150af174457eb3d4acf5583ace82'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:50.786017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0efc1c-1f32-4276-abf1-d618dd2fc928 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:50.788112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:50.789471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:50.789758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:50.790039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:50.791998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:50.797934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8f0f21f4-2104-47b5-b308-4663a2f19d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea32150af174457eb3d4acf5583ace82'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:50.811121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1041/2079] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:50 2022] DELETE /identity/v3/users/ea32150af174457eb3d4acf5583ace82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:50.816243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:50.816714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:50.817136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:50.833913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:50.835479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:50.858060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:50.859496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:50.871183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1039/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:50.903608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1042/2081] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:50.914371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:50.915795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:50.972231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9ad2-aac8-4b40-bf26-85848ae1a397 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:51.022316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:51.023648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:51.023932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:51.024219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:51.034886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:51.036340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:51.051259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1040/2082] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:51.374333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:51.375951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:51.392889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b100-5ad5-4847-ba40-bab1c070ff39 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:51.430635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:51.431745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:51.431973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:51.432253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] PATH_INFO: `/v3/projects/dede6c44cfdf4b08a1fee59b9ceb7bac` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:51.435674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dede6c44cfdf4b08a1fee59b9ceb7bac)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:51.437933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:51.510708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dede6c44cfdf4b08a1fee59b9ceb7bac', 'request_id': 'req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.529908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dede6c44cfdf4b08a1fee59b9ceb7bac', 'request_id': 'req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.538110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dede6c44cfdf4b08a1fee59b9ceb7bac', 'request_id': 'req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.552674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] The token cache is being invalidate because project dede6c44cfdf4b08a1fee59b9ceb7bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:51.552991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.553623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.555454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1043/2083] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:51 2022] DELETE /identity/v3/projects/dede6c44cfdf4b08a1fee59b9ceb7bac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:51.559317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:51.565554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:51.570711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa46eb-09a7-43ad-a495-03bc4748e0e7 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:51.629738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:51.630591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:51.630868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:51.631142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] PATH_INFO: `/v3/users/b068db2bffab464ea210e5c134863fc2` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:51.632866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b068db2bffab464ea210e5c134863fc2)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:51.634807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:51.684420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b068db2bffab464ea210e5c134863fc2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.697260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b068db2bffab464ea210e5c134863fc2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.697928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b068db2bffab464ea210e5c134863fc2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.698544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b068db2bffab464ea210e5c134863fc2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.706067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-07a30145-e8c2-4ed6-aa7a-7989309e77a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b068db2bffab464ea210e5c134863fc2'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:51.719648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1041/2084] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:51 2022] DELETE /identity/v3/users/b068db2bffab464ea210e5c134863fc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:52.055761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.057223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.070915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1371d0-874a-46d6-a8ef-c4d12eea58b4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.080756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:52.132746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.133610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.133897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.134178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] PATH_INFO: `/v3/projects/be5a4da5279545c38be4dcfd49c44f5c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.135359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5a4da5279545c38be4dcfd49c44f5c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.137345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.192040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5a4da5279545c38be4dcfd49c44f5c', 'request_id': 'req-08b00d5e-6d57-4993-a4a3-195cca8d52e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.202231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5a4da5279545c38be4dcfd49c44f5c', 'request_id': 'req-08b00d5e-6d57-4993-a4a3-195cca8d52e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.212372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5a4da5279545c38be4dcfd49c44f5c', 'request_id': 'req-08b00d5e-6d57-4993-a4a3-195cca8d52e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.226364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] The token cache is being invalidate because project be5a4da5279545c38be4dcfd49c44f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:52.226656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.227935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-08b00d5e-6d57-4993-a4a3-195cca8d52e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.229531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1044/2085] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:52 2022] DELETE /identity/v3/projects/be5a4da5279545c38be4dcfd49c44f5c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:52.234220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.234705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.234900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.256584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:52.257811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.323296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1042/2086] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:52.330948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.331684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.331976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.351999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:52.353241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.361616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1045/2087] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:52.365946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.377517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986bcab-55f8-442c-a967-e57aa3e096ee None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.383348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.384031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.384342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.384599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.385326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:52.385630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.387276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.402016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1043/2088] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:52.406358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.418584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39f807-e709-4e14-b351-cdf1621e7276 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.424306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.425006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.425292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.425572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.426286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.428260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.456712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1046/2089] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:52.458156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.469016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdd68-3346-4446-a6a5-332f2acae6d0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.477008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:52.530489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.531198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.531481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.531792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.532507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.535747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.558669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1044/2090] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:52.559801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.570911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be814-6ae0-4989-8d4e-36550400de49 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.576393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.577062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.577833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.577833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.578338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.580011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.594224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1047/2091] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:52.596051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.619338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551657d5-c95a-474e-9940-7b94ba6fa521 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.625442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.625985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.626339 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.626791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.627631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.629265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de776a-a96d-4061-81c1-2579852208d4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.647695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1045/2092] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:52.649017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.661101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d589a-2754-433c-bede-f51eee297d7c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.666153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.667033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.667318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.667644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] PATH_INFO: `/v3/projects/76c6e200b045460d8757d52faa1ab35b/users/9fb8408d0e4b4deea13416e61fe507bd/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.689147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c6e200b045460d8757d52faa1ab35b, user_id=9fb8408d0e4b4deea13416e61fe507bd, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.692045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.730902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1048/2093] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:52 2022] PUT /identity/v3/projects/76c6e200b045460d8757d52faa1ab35b/users/9fb8408d0e4b4deea13416e61fe507bd/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:52.742391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.742916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.743101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.762002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.763875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.776141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] MFA Rules not processed for user `9fb8408d0e4b4deea13416e61fe507bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:52.777400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.821597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:52.850457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8235c4-be49-4405-8b64-cb473b300202 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.856041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.856941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.857226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.857506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] PATH_INFO: `/v3/users/cd93276ba938439a91ae32216818258f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.858727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd93276ba938439a91ae32216818258f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.861293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.867261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1046/2094] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:52.868643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.891482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce219-f80b-4a2f-84ce-35ed00f7e67e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:52.898312 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:52.900919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:52.901550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:52.902796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:52.907530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:52.910398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:52.940257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd93276ba938439a91ae32216818258f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.941128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd93276ba938439a91ae32216818258f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.942078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd93276ba938439a91ae32216818258f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.952424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1047/2095] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:52.954411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd93276ba938439a91ae32216818258f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:52.957024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:52.960083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:52.977832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f3f92093-8b93-4233-a655-379a370d4129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd93276ba938439a91ae32216818258f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.001070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1049/2096] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:52 2022] DELETE /identity/v3/users/cd93276ba938439a91ae32216818258f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:53.006205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.009180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.009484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.041679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:53.043102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.077894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:53.084886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3139-236a-46ba-832f-bd0bc6a11c16 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.126371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1050/2097] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:53.134808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.136441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.198250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.198803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa387df-e3b8-48c2-a205-4bb0ece9dc34 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.199167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.199659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.200803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.201756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.202824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.203468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.203785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.204064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.204592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.218507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.224567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.234019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1051/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:53.236584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1048/2099] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:52 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:53.240766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.247887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:53.258285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84651-c8c1-4f90-85d7-a0cf1a2d0e93 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.270151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.270926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.271235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.271532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.272972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.275145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.288155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1052/2100] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:53.293053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.306178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbcd4-8ed9-4464-8f69-33b4a1faba89 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.313709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.315473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.315473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.315691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] PATH_INFO: `/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.344081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc78b4326de4b06b6cd7c66d1a81a14, user_id=bd2c7f0bb0ef45cbb84eff0f0c4a5d6a, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.347648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.373470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1049/2101] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:53 2022] PUT /identity/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:53.377290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.401601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bc987-59ec-43d2-ad68-9375d1ab9996 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.612405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.613649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.614866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.615374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.618794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.620970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.636737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1053/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:06:53.641363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.664551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771a6d-c390-471f-b57f-278759111e00 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.673751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.675230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.675613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.676125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] PATH_INFO: `/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.678456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc78b4326de4b06b6cd7c66d1a81a14, user_id=bd2c7f0bb0ef45cbb84eff0f0c4a5d6a, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.681556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6c54d-24fd-4396-a195-7678ae52b690 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.689303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.692061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.704060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1050/2103] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:53 2022] PUT /identity/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:53.711021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6638b77-4223-458d-9a28-700d6d23fa9d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:53.718352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.718352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.718352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.753262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] MFA Rules not processed for user `bd2c7f0bb0ef45cbb84eff0f0c4a5d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:53.754475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.825509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:53.826399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:53.826738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:53.826944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] PATH_INFO: `/v3/projects/d0f15743943e4cbdae13b2080d10810e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:53.828285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f15743943e4cbdae13b2080d10810e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:53.835789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:53.907553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1051/2104] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:53.928149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.930369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.940281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f15743943e4cbdae13b2080d10810e', 'request_id': 'req-36ca42c2-36f6-42e4-bb61-c10300aff00b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.950999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f15743943e4cbdae13b2080d10810e', 'request_id': 'req-36ca42c2-36f6-42e4-bb61-c10300aff00b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.957691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f15743943e4cbdae13b2080d10810e', 'request_id': 'req-36ca42c2-36f6-42e4-bb61-c10300aff00b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.972047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] The token cache is being invalidate because project d0f15743943e4cbdae13b2080d10810e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:53.972539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.973350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:53.975463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1054/2105] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:53 2022] DELETE /identity/v3/projects/d0f15743943e4cbdae13b2080d10810e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:53.979175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:53.981048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:53.985053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:54.000151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90736a0f-2e2a-4fd1-8f5f-1a35d1c2224c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.002960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:54.055642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca42c2-36f6-42e4-bb61-c10300aff00b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.057633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.058301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.058590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.058863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.060609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.060754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.061475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.061758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.062032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] PATH_INFO: `/v3/users/7a289d4e0ddf4b04a9d522657a65533d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.063212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a289d4e0ddf4b04a9d522657a65533d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.065198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.117679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a289d4e0ddf4b04a9d522657a65533d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.118369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a289d4e0ddf4b04a9d522657a65533d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.119027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a289d4e0ddf4b04a9d522657a65533d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.127522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a289d4e0ddf4b04a9d522657a65533d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.135851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.138202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.141743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a289d4e0ddf4b04a9d522657a65533d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.152268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1052/2106] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:54.159235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1055/2107] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:53 2022] DELETE /identity/v3/users/7a289d4e0ddf4b04a9d522657a65533d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:54.227898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.229644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.252471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3286c0-7673-4684-8101-3b053408428e service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.255463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.258074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.360008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.361047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.361386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.361783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] PATH_INFO: `/v3/users/ddbd2b13d2664a9db111f0a00a947124` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.363608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbd2b13d2664a9db111f0a00a947124)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.365596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2ae1-1523-4e0b-8d61-744c0e7e490f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.366730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.369099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.370079 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.370709 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.370987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.373147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.435117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbd2b13d2664a9db111f0a00a947124'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.437232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:54.451755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbd2b13d2664a9db111f0a00a947124'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.452585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbd2b13d2664a9db111f0a00a947124'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.453293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbd2b13d2664a9db111f0a00a947124'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.462712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-8b3e6205-015e-4c98-b832-bfa6ca25e497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbd2b13d2664a9db111f0a00a947124'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.467363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:54.484769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.486771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.495201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1053/2108] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:54 2022] DELETE /identity/v3/users/ddbd2b13d2664a9db111f0a00a947124 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:54.496371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.496371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.496575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.498109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1056/2109] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:54.514104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:54.515342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.593043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.598191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.631621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1054/2110] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:54.635722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ac80e-3d68-4da4-bbc9-e6b74db9a8a3 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.640953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.641944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.642233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.642556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] PATH_INFO: `/v3/projects/87f2c5a883d744158454d5450c43ea78` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.643422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.643898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f2c5a883d744158454d5450c43ea78)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.645962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.646084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.716294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f2c5a883d744158454d5450c43ea78', 'request_id': 'req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.723441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f2c5a883d744158454d5450c43ea78', 'request_id': 'req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.724402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f2e9-156a-4698-9d7d-c6d674da2d09 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.730888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f2c5a883d744158454d5450c43ea78', 'request_id': 'req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.744676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] The token cache is being invalidate because project 87f2c5a883d744158454d5450c43ea78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:54.745078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.745777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7b8d102c-8b7c-4d87-bbed-107db1bb63ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:54.747833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1057/2111] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:54 2022] DELETE /identity/v3/projects/87f2c5a883d744158454d5450c43ea78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:54.752503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118901e7-f614-429a-b26a-ab5695da1c9d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.752872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118901e7-f614-429a-b26a-ab5695da1c9d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.753238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118901e7-f614-429a-b26a-ab5695da1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.774016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-118901e7-f614-429a-b26a-ab5695da1c9d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:54.775265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-118901e7-f614-429a-b26a-ab5695da1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.786212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.786854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.787140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.787468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.789840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.830454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:54.844707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1058/2112] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:54.852768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.853059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.853338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.858659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.860634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.873381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:54.874967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:54.886654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1059/2113] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:54.891856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1055/2114] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:54.894823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.905145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb134184-de6e-4d9b-ae88-836cf6b3642f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.910505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.911103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.911742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.911742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.912403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:54.912724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.915103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.928266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1060/2115] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:54.931980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:54.942558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd28b00-938b-451b-85e9-6e70f3557b8b service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:54.947987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:54.948837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:54.949190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:54.949563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:54.950560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:54.952798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:54.989302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1056/2116] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:54 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:54.990795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.002673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564942b-aa95-4363-a49c-2d090392bf28 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.067573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:55.079569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.079569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.079569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.079569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.080132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.081666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.108174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1061/2117] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:54 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:55.112223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.127562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f45dde-2074-4845-a0ca-8467e61271ce admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.133958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.134667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.135135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.135419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.136216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.138087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.149962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1057/2118] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:55.153815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.167726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115e42-b70e-4533-b2e6-9535445b4a2a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.178452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.179145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.179430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.179742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.180503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.181480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.182088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.183371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.192955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1062/2119] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:55.198382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.208210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756976-545f-4b88-ad81-9ad528d62002 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.214779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.215776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.216134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.217519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] PATH_INFO: `/v3/projects/4988284bd9b74927827201a2b8917842/users/9cc3db69c5844a36bfafd072d8d291b5/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.242159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4988284bd9b74927827201a2b8917842, user_id=9cc3db69c5844a36bfafd072d8d291b5, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.245141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.260745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1063/2120] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:55 2022] PUT /identity/v3/projects/4988284bd9b74927827201a2b8917842/users/9cc3db69c5844a36bfafd072d8d291b5/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:55.264607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.266541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.268399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91918-457a-4e06-a279-f524f71790fe admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.328097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.328786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.329069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.329427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.331208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.334710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30a72-a934-44da-9403-57acb724da70 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.343566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.343566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.343879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.344340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] PATH_INFO: `/v3/projects/55aeeb05351f4b0c8534ef14025a29e1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.345982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55aeeb05351f4b0c8534ef14025a29e1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.347953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.396672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.400603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430828a-44c1-4fed-8f43-74a18dbe09c8 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.400944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55aeeb05351f4b0c8534ef14025a29e1', 'request_id': 'req-2cab68d2-7efa-4a50-ac46-b6342f4713e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.410595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1058/2121] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:55.411919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.412216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.412488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.413042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55aeeb05351f4b0c8534ef14025a29e1', 'request_id': 'req-2cab68d2-7efa-4a50-ac46-b6342f4713e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.420580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55aeeb05351f4b0c8534ef14025a29e1', 'request_id': 'req-2cab68d2-7efa-4a50-ac46-b6342f4713e9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.432451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:55.437556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] The token cache is being invalidate because project 55aeeb05351f4b0c8534ef14025a29e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:55.437931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.438689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.441350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1064/2122] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:55 2022] DELETE /identity/v3/projects/55aeeb05351f4b0c8534ef14025a29e1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:55.443911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] MFA Rules not processed for user `9cc3db69c5844a36bfafd072d8d291b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:55.446086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.446234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.457711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.529331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:55.565485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab68d2-7efa-4a50-ac46-b6342f4713e9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.571857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.572831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.573232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.573607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] PATH_INFO: `/v3/users/67a98127accd4104bec1a2f62451fbd2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.575174 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a98127accd4104bec1a2f62451fbd2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.575288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1059/2123] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:55.579553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.581066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.581327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.604881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d43d23-e4b2-4f1e-a0cb-a58fac9156f3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.611329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.612083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.612354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.612647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.613324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.615623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.651615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1060/2124] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:55 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:55.653946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a98127accd4104bec1a2f62451fbd2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.654806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a98127accd4104bec1a2f62451fbd2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.655939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.656378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a98127accd4104bec1a2f62451fbd2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.662750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:55.676809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a98127accd4104bec1a2f62451fbd2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.700490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a98127accd4104bec1a2f62451fbd2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:55.727455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1065/2125] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:55 2022] DELETE /identity/v3/users/67a98127accd4104bec1a2f62451fbd2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:55.776192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95baf8f-57a6-4cf2-90bf-650f14400555 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.855913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.856673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.857073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.857358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.858058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.860493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.892039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1061/2126] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:55 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:55.896690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.910366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8235-9825-487e-91f5-5ac671fdfa36 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.932990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:55.935076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:55.936791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:55.937171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:55.938366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:55.944777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:55.963419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1066/2127] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:55.973423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:55.991387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8bb7-d040-45c2-8afa-00edeadd873d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:55.999292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.000326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.000619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.002198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] PATH_INFO: `/v3/projects/614e8b10e85c49f99ae4e00fa17f0108/users/9d6ce87d0d68448fb5e0883b8bd6eb35/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.020332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:56.027313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614e8b10e85c49f99ae4e00fa17f0108, user_id=9d6ce87d0d68448fb5e0883b8bd6eb35, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.032923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.053350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1062/2128] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:55 2022] PUT /identity/v3/projects/614e8b10e85c49f99ae4e00fa17f0108/users/9d6ce87d0d68448fb5e0883b8bd6eb35/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:56.057387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.076717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725144a6-de10-4c15-8043-b5b2b3e2b091 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.164226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.166827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.177707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.178541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.178837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.179117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.180009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.181793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.196859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1067/2129] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:56.203566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.231543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00462-9ddd-4651-a48a-25f1f2d96bcf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.237773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.238950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.239934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.239934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] PATH_INFO: `/v3/projects/614e8b10e85c49f99ae4e00fa17f0108/users/9d6ce87d0d68448fb5e0883b8bd6eb35/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.241955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] RBAC: Authorizing `identity:create_grant(project_id=614e8b10e85c49f99ae4e00fa17f0108, user_id=9d6ce87d0d68448fb5e0883b8bd6eb35, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.245049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fb715-3a8b-4b55-a208-752a62ba50af admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.269207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1068/2130] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:56 2022] PUT /identity/v3/projects/614e8b10e85c49f99ae4e00fa17f0108/users/9d6ce87d0d68448fb5e0883b8bd6eb35/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:56.270817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.271113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.271600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.294511 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857747-b35b-46bf-b87a-3824d83e1172 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.320132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] MFA Rules not processed for user `9d6ce87d0d68448fb5e0883b8bd6eb35`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:56.322015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.362676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:56.365629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.367031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.367315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.367614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] PATH_INFO: `/v3/projects/22362441515646c09fd48ce2b4c115b5` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.368825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22362441515646c09fd48ce2b4c115b5)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.370812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.448698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1069/2131] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:56.457420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22362441515646c09fd48ce2b4c115b5', 'request_id': 'req-1d1cf222-fc13-4047-90c1-05714f9eeac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.467228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22362441515646c09fd48ce2b4c115b5', 'request_id': 'req-1d1cf222-fc13-4047-90c1-05714f9eeac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.479891 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.481958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.482883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22362441515646c09fd48ce2b4c115b5', 'request_id': 'req-1d1cf222-fc13-4047-90c1-05714f9eeac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.499292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] The token cache is being invalidate because project 22362441515646c09fd48ce2b4c115b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:56.500076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.500902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.503667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1063/2132] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:56 2022] DELETE /identity/v3/projects/22362441515646c09fd48ce2b4c115b5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:56.509726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.511316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.548609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6879-d370-47e9-b295-7530db6c1381 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.550299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:56.593140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf222-fc13-4047-90c1-05714f9eeac3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.598287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.599263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.599666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.599918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] PATH_INFO: `/v3/users/96453f140fc84cf4bd977efd81c46885` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.601268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96453f140fc84cf4bd977efd81c46885)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.603368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.605654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.606443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.606731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.607008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.609061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.653794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96453f140fc84cf4bd977efd81c46885'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.667380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96453f140fc84cf4bd977efd81c46885'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.668376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96453f140fc84cf4bd977efd81c46885'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.669799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96453f140fc84cf4bd977efd81c46885'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.677887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96453f140fc84cf4bd977efd81c46885'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:56.685184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.686904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.692123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1064/2133] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:56 2022] DELETE /identity/v3/users/96453f140fc84cf4bd977efd81c46885 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:56.698337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1070/2134] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:56.788534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.790071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.854390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a128d-295d-4a19-b783-57ad0db3d9b9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:56.858349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:56.859801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:56.860113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:56.860391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:56.863214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:56.930254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:56.931860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b310-d922-4dba-8d77-069185237895 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:56.943170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1065/2135] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:56.980077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:56.994637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b03d-5a3d-41c2-8e24-27496b80a894 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.029075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:57.098883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.100082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.100436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.100777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] PATH_INFO: `/v3/projects/33e60d2afad84e13816a03d54a745367` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.102490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e60d2afad84e13816a03d54a745367)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.104574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.173393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e60d2afad84e13816a03d54a745367', 'request_id': 'req-d8bc70ac-8a30-4917-85cd-8e8d79c77281'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.186068 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e60d2afad84e13816a03d54a745367', 'request_id': 'req-d8bc70ac-8a30-4917-85cd-8e8d79c77281'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.196143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e60d2afad84e13816a03d54a745367', 'request_id': 'req-d8bc70ac-8a30-4917-85cd-8e8d79c77281'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.214535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] The token cache is being invalidate because project 33e60d2afad84e13816a03d54a745367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:57.214535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.214535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d8bc70ac-8a30-4917-85cd-8e8d79c77281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.218162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1071/2136] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:56 2022] DELETE /identity/v3/projects/33e60d2afad84e13816a03d54a745367 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:57.228278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.228589 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.228877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.237195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:57.279270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:57.280615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:57.356432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1066/2137] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:57.364319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.364685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.365041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.386048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:57.387243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:57.395901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1072/2138] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:57.400728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.412810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53f737-a6cc-43a1-aeaf-0d29085c715c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.417660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.418384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.418670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.418942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.419723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:06:57.420029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.421668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.437698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1067/2139] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:06:57.439476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.448708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab85b8b-6bd2-4875-967f-58d79dd4aab1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.453638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.454304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.454584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.454855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.455587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.457731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.493011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1073/2140] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:06:57.495716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.509833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963068-5412-4e68-aa67-1cd0762bf65a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.597452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.598859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.599185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.599466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.600250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.603954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.636384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1068/2141] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:06:57.645257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.659021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ea04-b97b-4974-9969-fbcef18da35b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.665885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.666764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.667143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.667536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.668377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.670919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.685401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1074/2142] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:57.689521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.705959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4cc65-e395-446c-a938-745f8cdfef98 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.715790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.716754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.717065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.717367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.718348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.719258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.720845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.722737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:57.736425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1069/2143] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:06:57.738275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.744733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bec3e-9c56-4028-bf39-69f8632440b1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.757457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.758847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.759325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.759699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] PATH_INFO: `/v3/users/9fb8408d0e4b4deea13416e61fe507bd` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.759894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0336d-5a67-4c61-92c8-6628723a0193 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:57.761018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb8408d0e4b4deea13416e61fe507bd)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.763240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.765804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:57.766959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.767605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.768070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] PATH_INFO: `/v3/projects/8b3fb936e4ee49f1a3df208f0b32cc80/users/dd16ace77d1946a187cd05183de30e4a/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.785590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3fb936e4ee49f1a3df208f0b32cc80, user_id=dd16ace77d1946a187cd05183de30e4a, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:57.788505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caa6a7-7c1d-4b47-8cec-7181178d5860 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:57.815776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1070/2144] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:06:57 2022] PUT /identity/v3/projects/8b3fb936e4ee49f1a3df208f0b32cc80/users/dd16ace77d1946a187cd05183de30e4a/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:57.822208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.822523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.822766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.838328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb8408d0e4b4deea13416e61fe507bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.839890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb8408d0e4b4deea13416e61fe507bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.840706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb8408d0e4b4deea13416e61fe507bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.841325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:57.842539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:57.852864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb8408d0e4b4deea13416e61fe507bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.870156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:57.873150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-36975804-44d0-45ed-b375-447a8c57f2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb8408d0e4b4deea13416e61fe507bd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:57.893868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1075/2145] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:57 2022] DELETE /identity/v3/users/9fb8408d0e4b4deea13416e61fe507bd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:06:57.898265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:57.898571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:57.898935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:57.899443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:57.919111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:57.920865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:57.931139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1071/2146] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:57.941075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:57.943255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.003950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1076/2147] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:06:58.014686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:58.017004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.032351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c4c4-8957-432f-affa-b4176f088d66 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:58.113833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:58.114527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.114850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175f4d-233b-489e-a033-be0313358cb4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:58.114980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.115354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.119804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:58.120592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.120884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.121397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.136159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:58.137787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560a87a-ff90-4213-a9a6-0601814ce784 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:58.137909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:58.139705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:58.155882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1077/2148] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:58.158433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:58.164344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.166047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1072/2149] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:06:58.188285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700d45-d537-4963-9049-afbf4e259f57 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:58.193293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:58.194830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.195116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.195390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] PATH_INFO: `/v3/users/e9332cffa9ba44a3b7deb333ab670625` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.196681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9332cffa9ba44a3b7deb333ab670625)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:58.198852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:58.261445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9332cffa9ba44a3b7deb333ab670625'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:58.262060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9332cffa9ba44a3b7deb333ab670625'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:58.262871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9332cffa9ba44a3b7deb333ab670625'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:58.272066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9332cffa9ba44a3b7deb333ab670625'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:58.299922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9332cffa9ba44a3b7deb333ab670625'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:58.310854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:58.320297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1078/2150] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:58 2022] DELETE /identity/v3/users/e9332cffa9ba44a3b7deb333ab670625 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:58.322111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.322895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.323178 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.358106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:58.359728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.461884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1073/2151] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:06:58.499421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:58.503375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.622818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87c01-678f-433c-be15-33c26ef2c5b0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:58.627476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:58.628266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.628693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.628907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.650406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:58.652223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:58.666330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1079/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:06:58.880952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:58.883906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:58.910199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e83c1-ced0-4c7c-8ea8-17ba27b3503d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:58.916729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:58.918141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:58.918630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:58.940238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] PATH_INFO: `/v3/projects/76c6e200b045460d8757d52faa1ab35b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:58.944506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c6e200b045460d8757d52faa1ab35b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:58.947376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:59.047953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:59.063404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c6e200b045460d8757d52faa1ab35b', 'request_id': 'req-4b6d541e-60f0-401e-8801-9d9e05927265'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.070677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c6e200b045460d8757d52faa1ab35b', 'request_id': 'req-4b6d541e-60f0-401e-8801-9d9e05927265'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.078349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c6e200b045460d8757d52faa1ab35b', 'request_id': 'req-4b6d541e-60f0-401e-8801-9d9e05927265'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.099368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] The token cache is being invalidate because project 76c6e200b045460d8757d52faa1ab35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:59.099368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.100897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.102961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1074/2153] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:58 2022] DELETE /identity/v3/projects/76c6e200b045460d8757d52faa1ab35b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:59.106774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:59.117408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52644f-fdab-4b08-b3dd-71b8331fa9ac service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:59.191548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:59.192629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:59.193210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:59.193619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] PATH_INFO: `/v3/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:59.195040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2c7f0bb0ef45cbb84eff0f0c4a5d6a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:59.213395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:59.246490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:59.247989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:59.290574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d541e-60f0-401e-8801-9d9e05927265 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:59.303800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:59.304849 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:59.305274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:59.305727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] PATH_INFO: `/v3/projects/16c3f3d3f30b4086be5d579f3d65b4c4` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:59.310471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c3f3d3f30b4086be5d579f3d65b4c4)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:59.312350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:59.352602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2c7f0bb0ef45cbb84eff0f0c4a5d6a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.353307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2c7f0bb0ef45cbb84eff0f0c4a5d6a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.354128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2c7f0bb0ef45cbb84eff0f0c4a5d6a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.378754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2c7f0bb0ef45cbb84eff0f0c4a5d6a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.394816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2c7f0bb0ef45cbb84eff0f0c4a5d6a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.395450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c3f3d3f30b4086be5d579f3d65b4c4', 'request_id': 'req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.409726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c3f3d3f30b4086be5d579f3d65b4c4', 'request_id': 'req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.410161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1080/2154] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:59 2022] DELETE /identity/v3/users/bd2c7f0bb0ef45cbb84eff0f0c4a5d6a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:59.421548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c3f3d3f30b4086be5d579f3d65b4c4', 'request_id': 'req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.449965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] The token cache is being invalidate because project 16c3f3d3f30b4086be5d579f3d65b4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:06:59.450333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.451392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5ebf8c4b-544d-4f53-a198-6daf5ec81cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.453212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1075/2155] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:59 2022] DELETE /identity/v3/projects/16c3f3d3f30b4086be5d579f3d65b4c4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:59.458003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:59.460554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:59.513083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:06:59.583796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633e46-4a41-44d7-acf3-9a33f9adf8f4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:06:59.593124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:06:59.595049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:59.595774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:59.596402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] PATH_INFO: `/v3/users/335710a0e31c4aa696a79e04d07e4612` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:59.598245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=335710a0e31c4aa696a79e04d07e4612)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:06:59.601352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:06:59.701072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335710a0e31c4aa696a79e04d07e4612'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.703752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335710a0e31c4aa696a79e04d07e4612'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.704431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335710a0e31c4aa696a79e04d07e4612'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.722148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335710a0e31c4aa696a79e04d07e4612'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.747918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335710a0e31c4aa696a79e04d07e4612'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:06:59.771745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1081/2156] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:06:59 2022] DELETE /identity/v3/users/335710a0e31c4aa696a79e04d07e4612 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:06:59.787638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:06:59.788336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:06:59.788818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:06:59.859122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] MFA Rules not processed for user `dd16ace77d1946a187cd05183de30e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:06:59.862149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:06:59.902618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:06:59.904814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.047553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1076/2157] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:06:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:00.048664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.059651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.079606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b69d-8d14-4ab2-8873-ac3d2c6527cb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.099565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.099565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.099565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.099565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] PATH_INFO: `/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.099963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc78b4326de4b06b6cd7c66d1a81a14)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.101785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.138170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:00.174579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92f21-588b-4508-88c1-2f4acf94ceae None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.183729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.184397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.184687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.184965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.203542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:00.204476 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.206001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d1817-d3db-45d7-8a05-f84a94338513 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.210138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc78b4326de4b06b6cd7c66d1a81a14', 'request_id': 'req-c196eace-170c-4a38-9734-c6aab2d7c359'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.224386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc78b4326de4b06b6cd7c66d1a81a14', 'request_id': 'req-c196eace-170c-4a38-9734-c6aab2d7c359'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.242006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc78b4326de4b06b6cd7c66d1a81a14', 'request_id': 'req-c196eace-170c-4a38-9734-c6aab2d7c359'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.255055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1077/2158] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:00.263639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] The token cache is being invalidate because project 6dc78b4326de4b06b6cd7c66d1a81a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:00.263639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.264267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.266585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1082/2159] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:06:59 2022] DELETE /identity/v3/projects/6dc78b4326de4b06b6cd7c66d1a81a14 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:00.271384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb1f1-116b-4327-a97d-d27fbd80ec16 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.271964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb1f1-116b-4327-a97d-d27fbd80ec16 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.272567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb1f1-116b-4327-a97d-d27fbd80ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.297313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.299408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.337167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c86cb1f1-116b-4327-a97d-d27fbd80ec16 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:00.338426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c86cb1f1-116b-4327-a97d-d27fbd80ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.470945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196eace-170c-4a38-9734-c6aab2d7c359 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.477566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.479197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.485333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.485867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] PATH_INFO: `/v3/projects/b02711301264489cb3011458a8a9900b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.488103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02711301264489cb3011458a8a9900b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.490241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.509894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1078/2160] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:00.512550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.512902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.513186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.572581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:00.577128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.611080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02711301264489cb3011458a8a9900b', 'request_id': 'req-eb35c601-cde4-49a1-aae1-3b151d826688'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.629206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02711301264489cb3011458a8a9900b', 'request_id': 'req-eb35c601-cde4-49a1-aae1-3b151d826688'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.636682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02711301264489cb3011458a8a9900b', 'request_id': 'req-eb35c601-cde4-49a1-aae1-3b151d826688'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.667789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] The token cache is being invalidate because project b02711301264489cb3011458a8a9900b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:00.668091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.669553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.673247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1083/2161] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:00 2022] DELETE /identity/v3/projects/b02711301264489cb3011458a8a9900b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:00.677012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.681281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1079/2162] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:00.681921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.685712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.698145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1f9a-8b11-44d9-b107-ef35ec022c81 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.705723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.707195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.707336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.707527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.714268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:00.714594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.718881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.719598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c601-cde4-49a1-aae1-3b151d826688 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.729976 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.731939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.732220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.732494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] PATH_INFO: `/v3/users/33875ad3363a4ba689223321eeab47ac` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.735665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=33875ad3363a4ba689223321eeab47ac)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.740436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.747854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1080/2163] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:00.752150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.768397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42b35a-144b-4a36-8ab0-2eedf14c7154 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:00.775561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:00.776495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:00.776919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:00.777471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:00.778565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:00.782626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:00.857181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1081/2164] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:00 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:00.861604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33875ad3363a4ba689223321eeab47ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.863735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33875ad3363a4ba689223321eeab47ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.864725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33875ad3363a4ba689223321eeab47ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.865938 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:00.871228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:00.875047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33875ad3363a4ba689223321eeab47ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.877888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:00.896031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33875ad3363a4ba689223321eeab47ac'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:00.928693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1084/2165] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:00 2022] DELETE /identity/v3/users/33875ad3363a4ba689223321eeab47ac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:01.005858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:01.026929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f477f-18aa-4246-bad2-3ee9ea3cc57b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.110768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.111763 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.112056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.112337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.113081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.115077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.158682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1082/2166] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:00 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:01.159927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.172875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5af9-8568-41e0-a72b-5eb45b02e4be admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.179120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.179917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.180122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.180396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.181122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.182771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.199431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1085/2167] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:01.205985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.232970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce90a76-78e9-4053-8e92-4cd658b75364 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.250395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.251123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.251459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.252432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.253394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.255430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d6f8-c3f0-4e54-abbd-cef16d11b0e7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.295557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1083/2168] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:01.298086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.312380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870371-22fe-47dc-9cb3-cb3cd28e39eb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.325467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.326794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.327597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.328210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] PATH_INFO: `/v3/projects/53e8aa1e2c1542d984772a9a6d8e1dea/users/c5baa944f0c5448d9919fd18373f1f0a/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.388024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e8aa1e2c1542d984772a9a6d8e1dea, user_id=c5baa944f0c5448d9919fd18373f1f0a, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.390932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.443058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1086/2169] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:01 2022] PUT /identity/v3/projects/53e8aa1e2c1542d984772a9a6d8e1dea/users/c5baa944f0c5448d9919fd18373f1f0a/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:01.453719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.454044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.454354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.476955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.478840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:01.494358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] MFA Rules not processed for user `c5baa944f0c5448d9919fd18373f1f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:01.495964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:01.627935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3b95-d34f-4add-a7cc-9e0b95df027e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.642784 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.643748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.644527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.644527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] PATH_INFO: `/v3/projects/2494571d18cf4977b5d2372db1182ae9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.646205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2494571d18cf4977b5d2372db1182ae9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.650900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.669859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1084/2170] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:01.674780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.688434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f852-cb2a-4ad5-b256-9f75ee8cca03 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.693583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.694440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.694798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.695147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.696401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.699111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.735627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1085/2171] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:01.740565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.753001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2494571d18cf4977b5d2372db1182ae9', 'request_id': 'req-61069e5b-4265-4449-87cc-a95137f5d0c4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:01.763587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2494571d18cf4977b5d2372db1182ae9', 'request_id': 'req-61069e5b-4265-4449-87cc-a95137f5d0c4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:01.776129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2494571d18cf4977b5d2372db1182ae9', 'request_id': 'req-61069e5b-4265-4449-87cc-a95137f5d0c4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:01.798945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] The token cache is being invalidate because project 2494571d18cf4977b5d2372db1182ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:01.799267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:01.800238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-61069e5b-4265-4449-87cc-a95137f5d0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:01.801886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:01.811570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1087/2172] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:01 2022] DELETE /identity/v3/projects/2494571d18cf4977b5d2372db1182ae9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:01.814414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2162e-ef9b-46e4-a854-21a20d2d29ba None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.814414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2162e-ef9b-46e4-a854-21a20d2d29ba None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.814635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2162e-ef9b-46e4-a854-21a20d2d29ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.840268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5388a0-90a9-4109-a132-9af03f42298d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.843047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ddb2162e-ef9b-46e4-a854-21a20d2d29ba None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:01.844394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ddb2162e-ef9b-46e4-a854-21a20d2d29ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:01.848498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.849185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.849472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.849890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.851185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.854640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1088/2173] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:01.854808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.864124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.864699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.864819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.889688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1086/2174] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:01.890683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:01.892035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:01.893505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.895724 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:01.905875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1089/2175] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:01.907716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.918928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b19fe3-8f22-417a-b794-f18d78ba06e7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.922245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d19a4-1cef-456e-b49a-a44c2e3ce38f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.926334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.927408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.927752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.928119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.928937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:01.929232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.930793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.930944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.932469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.932802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.933151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.934019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.935987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.950854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1090/2176] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:01.952214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.954425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1087/2177] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:01.958337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:01.962205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:01.967097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae076-b6c0-4f1d-b44c-549dc092ea74 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.974264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.975041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.975449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.975858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:01.980031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:01.982627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e8e8-0182-4ae1-9742-8272cc192a1e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:01.988149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f9ef-59d7-4042-ba55-f26f491fec88 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:01.993685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:01.994694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:01.995059 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:01.995340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] PATH_INFO: `/v3/projects/10027d95518a432f9dfdbd0d1ec30203/users/41e0b6ae4df44b23b2ce0f5e6173a117/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.011602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1091/2178] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:01 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:02.016337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.016607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10027d95518a432f9dfdbd0d1ec30203, user_id=41e0b6ae4df44b23b2ce0f5e6173a117, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.016734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.016903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.019340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.034970 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] MFA Rules not processed for user `dd16ace77d1946a187cd05183de30e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:02.036266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1088/2179] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:01 2022] PUT /identity/v3/projects/10027d95518a432f9dfdbd0d1ec30203/users/41e0b6ae4df44b23b2ce0f5e6173a117/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:02.036403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.037311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.095057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1092/2180] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:02.095941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.101791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2706c18-893b-4f01-a6fc-39278570bc5a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.107361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4c50-8e59-4466-aa2c-b38f26753989 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.107489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.108398 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.108834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.109184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.109944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.111957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.112584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.113393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.114352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.114352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.114895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.116825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.128867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1093/2181] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:02.134843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.143709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1089/2182] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:02 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:02.150379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.151608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99005cc-3266-4cee-922e-ee2e1fe44e67 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.157189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.158153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.158332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.158610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] PATH_INFO: `/v3/projects/10027d95518a432f9dfdbd0d1ec30203/users/41e0b6ae4df44b23b2ce0f5e6173a117/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.160644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10027d95518a432f9dfdbd0d1ec30203, user_id=41e0b6ae4df44b23b2ce0f5e6173a117, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.160972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f5c8f-ea0c-4fa5-9222-fbff798b8778 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.163361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.166612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.167985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.168581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.169136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.170962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.172694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a772af-7d84-496f-911c-4b40fba450b1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.183551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1094/2183] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:02 2022] PUT /identity/v3/projects/10027d95518a432f9dfdbd0d1ec30203/users/41e0b6ae4df44b23b2ce0f5e6173a117/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:02.184906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1090/2184] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:02.189748 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.192709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9f2e-3dee-41cc-80df-8c83a506acb0 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.195920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9f2e-3dee-41cc-80df-8c83a506acb0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.196215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9f2e-3dee-41cc-80df-8c83a506acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.233598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-83fb9f2e-3dee-41cc-80df-8c83a506acb0 None None] MFA Rules not processed for user `41e0b6ae4df44b23b2ce0f5e6173a117`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:02.234816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-83fb9f2e-3dee-41cc-80df-8c83a506acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.275386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448989-65d5-4494-967f-d5bac5ae2ca5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.281006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.281683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.281967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.282292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.283025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.284865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015757-e593-4be6-9408-b589f40a6931 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.297229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1095/2185] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:07:02.298906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a0a6-def4-4441-8277-7902ab4258bf None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.299475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a0a6-def4-4441-8277-7902ab4258bf None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.299475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5a0a6-def4-4441-8277-7902ab4258bf None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.301416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1096/2186] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:07:02.302125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a0a6-def4-4441-8277-7902ab4258bf None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.327483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5a0a6-def4-4441-8277-7902ab4258bf None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.332367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.333287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.333556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.333833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] PATH_INFO: `/v3/projects/f4df022e4edb480c8507f921ca0a96a6/users/56ca9bbe23f84a99b674e0c36d923dec/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.350102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:02.355927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1091/2187] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:02.357347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.357796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.358151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.380610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4df022e4edb480c8507f921ca0a96a6, user_id=56ca9bbe23f84a99b674e0c36d923dec, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.384335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.412068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:02.413534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.423607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1097/2188] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:02 2022] PUT /identity/v3/projects/f4df022e4edb480c8507f921ca0a96a6/users/56ca9bbe23f84a99b674e0c36d923dec/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:02.430004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.432214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.474617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:02.490038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1092/2189] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:02.491452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.492947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.502737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35b27-2452-4c5b-acfe-7884d1d67dd3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.508588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.509610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.509816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.510310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.569525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4f92-c994-48d9-9014-51229fc978cb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.574600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.575608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.575982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.576333 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] PATH_INFO: `/v3/users/dde622e34c10487a8e7cc1be4a9eef1e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.577674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde622e34c10487a8e7cc1be4a9eef1e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.579752 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.579899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.581579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af8e5-cf2b-44b9-a718-b7f6af59e8e2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.592982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1098/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:02.594066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.594431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.594878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.616730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:02.616730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.633701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1099/2191] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:02.634320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.646290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.674339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15573b-a84b-4764-b58d-f5dfb86cad2a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.679423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde622e34c10487a8e7cc1be4a9eef1e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:02.683357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.683911 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.684299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.684657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.700628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.700628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.706672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde622e34c10487a8e7cc1be4a9eef1e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:02.708122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde622e34c10487a8e7cc1be4a9eef1e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:02.708897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde622e34c10487a8e7cc1be4a9eef1e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:02.718371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde622e34c10487a8e7cc1be4a9eef1e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:02.720025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1100/2192] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:02.728842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.731370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.736075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1093/2193] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:02 2022] DELETE /identity/v3/users/dde622e34c10487a8e7cc1be4a9eef1e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:02.737502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:02.742115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.766846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:02.826709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57e131-3b6c-4401-845e-9dcf25b4028a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.836254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.836923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.837209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.837524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.837896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f28d-f340-42ed-8f3a-b92750e1bb15 service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:02.839394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.940282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:02.940490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:02.941288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:02.941825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:02.942304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:02.942713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:02.945347 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:02.957076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1094/2194] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:03.022816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.022924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:03.024964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.096539 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.099450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.123803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1101/2195] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:03.124758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.130157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e29a9c-64a3-4fba-967c-f719115751de service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.130837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.135442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.136515 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.136909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.137117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] PATH_INFO: `/v3/users/9cc3db69c5844a36bfafd072d8d291b5` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.138582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc3db69c5844a36bfafd072d8d291b5)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.141888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.169317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911caa6-bc5b-4749-95f4-ea4ea88482bc service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.175269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.175836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.176108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.176382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] PATH_INFO: `/v3/projects/46c0bf6b1c3546b7bc0b88e6edf581f7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.177961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c0bf6b1c3546b7bc0b88e6edf581f7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.180328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.242225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc3db69c5844a36bfafd072d8d291b5'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.261474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc3db69c5844a36bfafd072d8d291b5'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.262199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c0bf6b1c3546b7bc0b88e6edf581f7', 'request_id': 'req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.263152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc3db69c5844a36bfafd072d8d291b5'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.264113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc3db69c5844a36bfafd072d8d291b5'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.273717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c0bf6b1c3546b7bc0b88e6edf581f7', 'request_id': 'req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.277547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-61842c98-3e2c-4488-a39b-3bd2c322a550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc3db69c5844a36bfafd072d8d291b5'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.280175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:03.283554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c0bf6b1c3546b7bc0b88e6edf581f7', 'request_id': 'req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.313965 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] The token cache is being invalidate because project 46c0bf6b1c3546b7bc0b88e6edf581f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:03.314575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.315128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1095/2196] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:03 2022] DELETE /identity/v3/users/9cc3db69c5844a36bfafd072d8d291b5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:03.315444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-0118cdde-2ea9-48ff-b4d6-cbbed35665c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:03.321003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.321305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.321872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.322926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1102/2197] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:03 2022] DELETE /identity/v3/projects/46c0bf6b1c3546b7bc0b88e6edf581f7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:03.327789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b983-c9a5-4e31-9fc0-7d1bd2ab5a96 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.327997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b983-c9a5-4e31-9fc0-7d1bd2ab5a96 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.328266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b983-c9a5-4e31-9fc0-7d1bd2ab5a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.356556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:03.358171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.388550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6c68b983-c9a5-4e31-9fc0-7d1bd2ab5a96 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:03.391977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6c68b983-c9a5-4e31-9fc0-7d1bd2ab5a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.439470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1096/2198] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:03.454013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.456356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.564658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1103/2199] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:03.572955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.573955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.573955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.586105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1de91-8536-46b8-81c2-4b93314a9344 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.594304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.596583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.597475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.600848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.611484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:03.613012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:03.615156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.617003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.626642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1104/2200] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:03.628304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1097/2201] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:03.630934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.641674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7226ac0-4553-49c9-b2aa-2257cff71719 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.647612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.648275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.649042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.649042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.649552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:03.649871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.652240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.665281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1105/2202] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:07:03.669825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.681045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f470d8-7adb-42df-b89d-a2e30200731f service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.686717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.687378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.687730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.688009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.688719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.690640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.728744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1098/2203] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:03 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:03.730022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.742677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35cf29-56de-4711-bcd9-907d152baff9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.779871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:03.819399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.821564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.821835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.822120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.822839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.824819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.852773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.852982 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1106/2204] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:03 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:03.863633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd27104-b598-44ea-a8ba-7df4cb4409af admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.870176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.870931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.871463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.871847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.872660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.874354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.891289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1099/2205] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:07:03.895297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.906317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fb97-6933-4314-94f0-39ca64bd902a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.913752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.914608 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.915058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.915678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.916358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.918781 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9381f8-a1c3-4096-83f9-455acb39d16d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:03.931452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1107/2206] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:03.935293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:03.945949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72114ee-7cbb-472a-9ebc-1c243328750b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:03.951675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:03.952760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:03.953399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:03.953399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] PATH_INFO: `/v3/projects/c30bf61e758f4599b37014f6fd9f2307/users/a0a8868b97c4487385b7cc46c9d769f2/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:03.971343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30bf61e758f4599b37014f6fd9f2307, user_id=a0a8868b97c4487385b7cc46c9d769f2, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:03.974751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625c3bc-6389-499f-8085-c3146cf1c3dd admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.000451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1100/2207] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:03 2022] PUT /identity/v3/projects/c30bf61e758f4599b37014f6fd9f2307/users/a0a8868b97c4487385b7cc46c9d769f2/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:04.002188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.002489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.002819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.039445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:04.041249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.129500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.129961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.130268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.154838 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1108/2208] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:04.164232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.166156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.175701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] MFA Rules not processed for user `56ca9bbe23f84a99b674e0c36d923dec`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:04.177306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.220291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:04.254565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2c8d-0941-4241-8a8a-f0b223cebade None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.261958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.262780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.263158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.263489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.277624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.279239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.283956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1101/2209] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:04.283956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.283956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.298124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1109/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:04.299159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.299376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a793e-d52b-4150-97f1-db0fb679ab25 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.300951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.305415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.306531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.306909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.307413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] PATH_INFO: `/v3/projects/4988284bd9b74927827201a2b8917842` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.309115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4988284bd9b74927827201a2b8917842)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.311158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.325141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c7dfb-67a4-40b2-b38a-3fbc82e119a2 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.332873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.334618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.335169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.336122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.337049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.339741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.388519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4988284bd9b74927827201a2b8917842', 'request_id': 'req-88640d28-a224-415f-9a02-e8000c049f7a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.397239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4988284bd9b74927827201a2b8917842', 'request_id': 'req-88640d28-a224-415f-9a02-e8000c049f7a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.407268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1110/2211] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:04 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:04.409822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4988284bd9b74927827201a2b8917842', 'request_id': 'req-88640d28-a224-415f-9a02-e8000c049f7a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.413164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.434932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] The token cache is being invalidate because project 4988284bd9b74927827201a2b8917842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:04.435362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.436119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.438927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1102/2212] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:04 2022] DELETE /identity/v3/projects/4988284bd9b74927827201a2b8917842 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:04.443825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.446625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.480847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:04.537051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a29e-1a20-4674-b888-988d2c71ba1d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.562390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.564341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.566289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.570650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.573734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.575870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640d28-a224-415f-9a02-e8000c049f7a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.579943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.589613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.595019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.596516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.596835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] PATH_INFO: `/v3/users/9d6ce87d0d68448fb5e0883b8bd6eb35` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.603910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6ce87d0d68448fb5e0883b8bd6eb35)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.607370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.649546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1111/2213] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:04 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:04.653298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.657313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:04.674705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c44da-30b7-4fbd-8840-0a3a6b3d0519 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.684359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.685363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.685887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.687316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.687316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.689210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.703154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1112/2214] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:04.707949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.710130 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6ce87d0d68448fb5e0883b8bd6eb35'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.712385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:04.734088 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc719d8a-cd67-44e2-8439-35ee2ccf1652 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:04.741239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6ce87d0d68448fb5e0883b8bd6eb35'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.741555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:04.742348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6ce87d0d68448fb5e0883b8bd6eb35'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.742890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:04.743231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6ce87d0d68448fb5e0883b8bd6eb35'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.743645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:04.744105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] PATH_INFO: `/v3/projects/308ff1af7a394e56b062f62a39674fff/users/ee592a01e88d4246b888257081faf3f6/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:04.760921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6ce87d0d68448fb5e0883b8bd6eb35'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:04.775558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308ff1af7a394e56b062f62a39674fff, user_id=ee592a01e88d4246b888257081faf3f6, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:04.778284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:04.792574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1103/2215] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:04 2022] DELETE /identity/v3/users/9d6ce87d0d68448fb5e0883b8bd6eb35 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:04.833856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1113/2216] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:04 2022] PUT /identity/v3/projects/308ff1af7a394e56b062f62a39674fff/users/ee592a01e88d4246b888257081faf3f6/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:04.837711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:04.839426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:05.009775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5e3e7-b06e-48db-b4d7-8edc68a5cbfa admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:05.076117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:05.077088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.077461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.080943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.082125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:05.083538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:05.099579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1104/2217] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:05.100531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:05.114398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb213-1dbf-4d23-9c7c-4679220e5444 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:05.121284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:05.122187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.122724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.123169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] PATH_INFO: `/v3/projects/308ff1af7a394e56b062f62a39674fff/users/ee592a01e88d4246b888257081faf3f6/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.125504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=308ff1af7a394e56b062f62a39674fff, user_id=ee592a01e88d4246b888257081faf3f6, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:05.129098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bd366-2762-4a73-bde6-438c8ed792fe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:05.147137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1114/2218] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:05 2022] PUT /identity/v3/projects/308ff1af7a394e56b062f62a39674fff/users/ee592a01e88d4246b888257081faf3f6/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:05.398058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:05.401045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:05.430668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61b9a-fd9a-4ba6-9c95-9fd3e1c274c8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:05.565927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:05.566864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.567617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.568493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] PATH_INFO: `/v3/projects/614e8b10e85c49f99ae4e00fa17f0108` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.570233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=614e8b10e85c49f99ae4e00fa17f0108)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:05.572946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:05.593480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:05.651308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614e8b10e85c49f99ae4e00fa17f0108', 'request_id': 'req-845e7aa2-55aa-4623-a9df-1e3892504eec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:05.660250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614e8b10e85c49f99ae4e00fa17f0108', 'request_id': 'req-845e7aa2-55aa-4623-a9df-1e3892504eec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:05.669532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614e8b10e85c49f99ae4e00fa17f0108', 'request_id': 'req-845e7aa2-55aa-4623-a9df-1e3892504eec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:05.692266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] The token cache is being invalidate because project 614e8b10e85c49f99ae4e00fa17f0108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:05.692564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:05.693381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-845e7aa2-55aa-4623-a9df-1e3892504eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:05.696617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1105/2219] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:05 2022] DELETE /identity/v3/projects/614e8b10e85c49f99ae4e00fa17f0108 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:05.714597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.714597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.714597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.735234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:05.736725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:05.842846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1115/2220] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:05.852330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.852969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.853389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.879998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:05.882773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:05.902723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:05.910249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1106/2221] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:05.915080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24919-c4ca-4cdf-923f-9fc75ebf6979 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:05.920885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:05.924620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.925641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.926022 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:05.927243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:05.929070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:05.931006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:05.967679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1116/2222] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:05.969004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:05.988409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950a2c6-4434-4af9-8f0f-6abe60b27d35 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:05.995787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:05.996594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:05.996978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:05.997359 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.000397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.002530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.031628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.033504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.060198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1107/2223] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:05 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:06.065762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c9da-ab6e-4e14-b368-01bc950ec07a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.068234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.207415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f83ad-10ac-4f9e-95f2-55eb514170a4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.228170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.229655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.232405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.233144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.233591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.234457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.235742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.236143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.237246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] PATH_INFO: `/v3/users/c5baa944f0c5448d9919fd18373f1f0a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.240072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5baa944f0c5448d9919fd18373f1f0a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.242920 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.244614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.252995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:06.285012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1108/2224] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:06 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:06.292084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.303171 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8cba2-eedd-42ad-924e-7bf8dea6e5ff admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.308520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.309817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.309817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.310217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.311463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.313221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.331907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1109/2225] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:06.332974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.347530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6db8e-543b-4192-b453-8707ecfa9d3d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.355928 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.356654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.356944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.357334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.358183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.361049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.378690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5baa944f0c5448d9919fd18373f1f0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:06.379270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5baa944f0c5448d9919fd18373f1f0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:06.380735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5baa944f0c5448d9919fd18373f1f0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:06.384461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1110/2226] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:06.390018 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.392541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.397546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5baa944f0c5448d9919fd18373f1f0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:06.411465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ed1f9-4c96-419d-b49e-98f0080512ee admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.417529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.418757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.419150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.419517 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] PATH_INFO: `/v3/projects/78f8ee84c76143a18583fc10906e6dde/users/c5e47530537f429e812b8b16fb8f488a/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.444514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f8ee84c76143a18583fc10906e6dde, user_id=c5e47530537f429e812b8b16fb8f488a, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.447205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6b19041-e20c-4b6b-a965-13e6962be53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5baa944f0c5448d9919fd18373f1f0a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:06.449837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4294ee-781b-474e-a8b6-0c8be8f67feb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.475020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1111/2227] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:06 2022] PUT /identity/v3/projects/78f8ee84c76143a18583fc10906e6dde/users/c5e47530537f429e812b8b16fb8f488a/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:06.486355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19890-6d07-4411-b555-39e040e58421 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.495377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19890-6d07-4411-b555-39e040e58421 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.495377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19890-6d07-4411-b555-39e040e58421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.495663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1117/2228] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:06 2022] DELETE /identity/v3/users/c5baa944f0c5448d9919fd18373f1f0a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:06.495663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.495663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.495663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.542974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:06.544993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.593579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dab19890-6d07-4411-b555-39e040e58421 None None] MFA Rules not processed for user `c5e47530537f429e812b8b16fb8f488a`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:06.596405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dab19890-6d07-4411-b555-39e040e58421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.626489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:06.743412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1118/2229] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:06.783596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1112/2230] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:06.792033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.793992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.797599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab19890-6d07-4411-b555-39e040e58421 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:06.799796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dab19890-6d07-4411-b555-39e040e58421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:06.920030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab19890-6d07-4411-b555-39e040e58421 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.927493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1db26-615c-4234-934f-b48abef53712 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:06.943226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.944122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.944662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.945105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.951692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:06.953835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:06.955805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:06.956268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:06.977975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.982381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c09d7-cf43-4cc8-94b4-8dcdc488e47e service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:06.983456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:06.991688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:07.011688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1113/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:07:07.013471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.017661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1119/2232] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:07.031647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.031647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.039934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:07.061992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec61045-7b50-4207-bd60-2cecf57bba98 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:07.094941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:07.097039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.097593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.098346 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] PATH_INFO: `/v3/users/c5e47530537f429e812b8b16fb8f488a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.101318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e47530537f429e812b8b16fb8f488a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:07.103793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:07.104561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] MFA Rules not processed for user `ee592a01e88d4246b888257081faf3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:07.105386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.141240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:07.197131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e47530537f429e812b8b16fb8f488a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.198046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e47530537f429e812b8b16fb8f488a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.199045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e47530537f429e812b8b16fb8f488a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.214577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e47530537f429e812b8b16fb8f488a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.249871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-2f81bbac-f3f6-4bc5-a129-4cb3e438fe08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e47530537f429e812b8b16fb8f488a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.251857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1114/2233] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:07.261221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:07.262668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.271091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1120/2234] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:07 2022] DELETE /identity/v3/users/c5e47530537f429e812b8b16fb8f488a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:07.273392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.273739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.274021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.298543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:07.298738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca99742-7338-4d78-a7a7-9ef3d1d6cb44 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:07.299897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.367133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:07.409821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:07.411466 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.412118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.413766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.417489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.433525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1121/2235] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:07.448736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:07.456584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.528238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:07.530165 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:07.543264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1115/2236] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:07.543547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5b6b-1675-4e33-a588-4138113c485d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:07.549855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:07.551025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.551025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.551383 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.580160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:07.582579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:07.612199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1122/2237] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:07.701481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:07.702958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:07.747232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23c8d-0789-4816-a8d6-1c2df04ab032 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:07.767397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:07.768497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:07.770017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:07.770553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] PATH_INFO: `/v3/projects/53e8aa1e2c1542d984772a9a6d8e1dea` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:07.775407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e8aa1e2c1542d984772a9a6d8e1dea)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:07.777829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:07.870182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e8aa1e2c1542d984772a9a6d8e1dea', 'request_id': 'req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.883232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e8aa1e2c1542d984772a9a6d8e1dea', 'request_id': 'req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.901985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e8aa1e2c1542d984772a9a6d8e1dea', 'request_id': 'req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.925231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] The token cache is being invalidate because project 53e8aa1e2c1542d984772a9a6d8e1dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:07.925824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.927016 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:07.930302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1116/2238] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:07 2022] DELETE /identity/v3/projects/53e8aa1e2c1542d984772a9a6d8e1dea => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:07.933967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:07.947402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864faf-163f-42c3-9e2e-7a2c27d06730 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:08.054290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:08.103133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:08.104051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.104334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.104617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] PATH_INFO: `/v3/users/41e0b6ae4df44b23b2ce0f5e6173a117` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.107928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e0b6ae4df44b23b2ce0f5e6173a117)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:08.108710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:08.243448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e0b6ae4df44b23b2ce0f5e6173a117'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.244197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e0b6ae4df44b23b2ce0f5e6173a117'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.244894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e0b6ae4df44b23b2ce0f5e6173a117'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.258949 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:08.261320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e0b6ae4df44b23b2ce0f5e6173a117'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.263134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:08.288262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d758-91fe-4e7d-9657-f94fd0ceb93d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:08.290124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-112b7306-ae22-4c91-b2e2-d994c52ccf58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e0b6ae4df44b23b2ce0f5e6173a117'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.307972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:08.308856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.309142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.309416 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] PATH_INFO: `/v3/projects/78f8ee84c76143a18583fc10906e6dde` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.313654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f8ee84c76143a18583fc10906e6dde)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:08.317835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:08.321333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1123/2239] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:07 2022] DELETE /identity/v3/users/41e0b6ae4df44b23b2ce0f5e6173a117 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:08.421460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f8ee84c76143a18583fc10906e6dde', 'request_id': 'req-e665a969-b040-4d2f-91de-e111853deebb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.436755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f8ee84c76143a18583fc10906e6dde', 'request_id': 'req-e665a969-b040-4d2f-91de-e111853deebb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.448360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f8ee84c76143a18583fc10906e6dde', 'request_id': 'req-e665a969-b040-4d2f-91de-e111853deebb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.452304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:08.485208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] The token cache is being invalidate because project 78f8ee84c76143a18583fc10906e6dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:08.487734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.488658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e665a969-b040-4d2f-91de-e111853deebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:08.494437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1117/2240] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:08 2022] DELETE /identity/v3/projects/78f8ee84c76143a18583fc10906e6dde => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:08.496354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.496902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.497014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.517209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:08.518433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:08.603328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1124/2241] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:08.612195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.612486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.612994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.642024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:08.643822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:08.660038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1118/2242] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:08.661473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:08.672181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6c356-ffa8-4844-94ce-0523a14689c2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:08.679095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:08.679923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.680302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.680819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.681653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:08.682627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:08.684629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:08.705114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1125/2243] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:07:08.710083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:08.764994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa371-e85a-4773-9cad-67f20fbb5cd7 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:08.780244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:08.781182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:08.781618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:08.782041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:08.782929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:08.785214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:08.852525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1119/2244] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:08 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:08.854135 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:08.869173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c26ea-b762-4d50-bf9f-faeb272f94e6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:08.962638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:08.965256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:08.985853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:09.008224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.008224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.008687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.009059 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.010017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.012417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.039771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1126/2245] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:08 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:09.042998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.059031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a55a4-628e-485d-a1ab-1f987b76820d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.069607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.070431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.070829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.071201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.072132 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.073936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.077324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12988d7a-6ab8-4c8e-8dff-66e436692ed9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.082965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.084089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.084950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.085378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] PATH_INFO: `/v3/projects/10027d95518a432f9dfdbd0d1ec30203` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.086736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10027d95518a432f9dfdbd0d1ec30203)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.087181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1127/2246] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:09.089066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.090616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.102294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063854-c60a-4633-9459-ae7ee4491009 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.107480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.108144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.108434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.108717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.109583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.112234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.127148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1128/2247] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:07:09.128388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.142500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ecad-b3f3-4c26-8ae3-a431e653b911 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.169464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10027d95518a432f9dfdbd0d1ec30203', 'request_id': 'req-b95e2b8d-c594-4fec-8276-34b04cbe87b1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:09.171926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10027d95518a432f9dfdbd0d1ec30203', 'request_id': 'req-b95e2b8d-c594-4fec-8276-34b04cbe87b1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:09.178943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10027d95518a432f9dfdbd0d1ec30203', 'request_id': 'req-b95e2b8d-c594-4fec-8276-34b04cbe87b1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:09.198028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] The token cache is being invalidate because project 10027d95518a432f9dfdbd0d1ec30203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:09.198707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:09.200080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b95e2b8d-c594-4fec-8276-34b04cbe87b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:09.202162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1120/2248] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:08 2022] DELETE /identity/v3/projects/10027d95518a432f9dfdbd0d1ec30203 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:09.213082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04416-44a3-43cf-81ce-30c828c70321 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.213366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04416-44a3-43cf-81ce-30c828c70321 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.213720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04416-44a3-43cf-81ce-30c828c70321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.235973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.236875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.237156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.237435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] PATH_INFO: `/v3/projects/e5da48c04ece4458a69ad6145d767122/users/35a18c9cade44c5d95877c5c1b9130eb/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.245399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6ce04416-44a3-43cf-81ce-30c828c70321 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:09.246884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6ce04416-44a3-43cf-81ce-30c828c70321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:09.262715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1121/2249] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:09.263812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5da48c04ece4458a69ad6145d767122, user_id=35a18c9cade44c5d95877c5c1b9130eb, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.266649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.266941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.267267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.267435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271a7ff-6186-4af7-a399-eb99465e135b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.285195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1129/2250] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:09 2022] PUT /identity/v3/projects/e5da48c04ece4458a69ad6145d767122/users/35a18c9cade44c5d95877c5c1b9130eb/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:09.294755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:09.296640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.297086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.297673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.300437 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:09.335554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] MFA Rules not processed for user `35a18c9cade44c5d95877c5c1b9130eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:09.337163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:09.370571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:09.400631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1122/2251] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:09.401735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.418368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9addc53-2e3b-454e-bf01-a320753b9192 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.422600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1130/2252] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:09.425780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.426723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.427010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.427286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.428873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:09.428979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.430523 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.435327 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.441634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:09.449021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1123/2253] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:09.449643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.465289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10cfe-6cf1-4119-b635-6a0403851e55 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.472606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.473445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.474697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.475686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.476485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.479136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.501560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:09.523706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1124/2254] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:09.536125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.548764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c4b3a-85ea-4c85-8924-28082283cf5f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.626307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.628195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.628593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.629026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.637700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad45e-4b66-4904-8a6e-16a2aa43f9b3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.645109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.645932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.646360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.646761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.647664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.650409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.685188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1125/2255] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:09.689413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.732319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a828-9d1f-4aa3-ae8b-ab667fd7dccd admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.738848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.739995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.740282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.741459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.742216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.744116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.765861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.768010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.773307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1126/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:09.778732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.784655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1131/2257] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:09.798129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c796-9fe8-4e1c-9974-f9702cd43991 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.809033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.811572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.813726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.814024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.815785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.817357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80755-7695-4dea-a910-c178c01fdda3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.848653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1127/2258] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:09.853572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:09.871670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b85f3e-324d-49e8-886d-e850a6daa471 service glance] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:09.895664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:09.897212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:09.897594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:09.898249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] PATH_INFO: `/v3/projects/54aa38ae2a1e4c27b5f03f7eff8dac4e/users/db7a794936034d3c86195edde18afb3f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:09.953885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=54aa38ae2a1e4c27b5f03f7eff8dac4e, user_id=db7a794936034d3c86195edde18afb3f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:09.956599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:09.987868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1132/2259] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:09 2022] PUT /identity/v3/projects/54aa38ae2a1e4c27b5f03f7eff8dac4e/users/db7a794936034d3c86195edde18afb3f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:09.999096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb67d-b963-4c37-b1cc-605064f4d8ea None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:10.000166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb67d-b963-4c37-b1cc-605064f4d8ea None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:10.000600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb67d-b963-4c37-b1cc-605064f4d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:10.047968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-557bb67d-b963-4c37-b1cc-605064f4d8ea None None] MFA Rules not processed for user `db7a794936034d3c86195edde18afb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:10.051597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-557bb67d-b963-4c37-b1cc-605064f4d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:10.142630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1128/2260] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:10.154766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:10.156546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:10.323038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bc9f-8c9d-4b93-995c-2d5c468384cd admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:10.327907 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:10.328896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:10.329431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:10.329962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:10.342693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:10.344344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0ba52-5271-48d3-8be8-361c6134ce26 service glance] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:10.374043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1133/2261] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:07:11.006810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:11.007833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:11.009235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:11.047278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:11.058222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] MFA Rules not processed for user `a0a8868b97c4487385b7cc46c9d769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:11.061363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:11.175569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1129/2262] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:11.186664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:11.187423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:11.187423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:11.230207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] MFA Rules not processed for user `a0a8868b97c4487385b7cc46c9d769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:11.230207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:11.241536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1134/2263] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:11.248491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:11.250180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:11.329743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:11.331128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:11.342691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:11.351908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827540-c2d4-4f35-8f09-00422d55362d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:11.358405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:11.359300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:11.359612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:11.359890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:11.370063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:11.371262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fbce5-e439-4104-9a45-7628dbb76e69 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:11.381036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1130/2264] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:11.403997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab7ba6-23ba-4e00-bf09-e55905fb19e3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:11.408621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:11.409351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:11.410209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:11.410209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:11.412005 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:11.510419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:11.512937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:11.529914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1135/2265] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:07:12.375889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a46b56-3fb4-406b-9adc-3fedd4cf2bdb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:12.376759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a46b56-3fb4-406b-9adc-3fedd4cf2bdb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:12.377204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a46b56-3fb4-406b-9adc-3fedd4cf2bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:12.416518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-57a46b56-3fb4-406b-9adc-3fedd4cf2bdb None None] MFA Rules not processed for user `a0a8868b97c4487385b7cc46c9d769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:12.417753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-57a46b56-3fb4-406b-9adc-3fedd4cf2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:12.445377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1131/2266] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:21.521194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=46 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:22.401537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=64 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:23.020884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:23.022440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:23.102182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1765-2f65-4d66-b59a-facfe88d2eac service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:23.106984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:23.107934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:23.108216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:23.108512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] PATH_INFO: `/v3/users/f6698c1613af4d218875192c98ea3e31` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:23.109740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6698c1613af4d218875192c98ea3e31)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:23.114521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:23.197545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6698c1613af4d218875192c98ea3e31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:23.198337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6698c1613af4d218875192c98ea3e31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:23.199444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6698c1613af4d218875192c98ea3e31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:23.208330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6698c1613af4d218875192c98ea3e31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:23.231977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6698c1613af4d218875192c98ea3e31'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:23.254803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1136/2267] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:23 2022] DELETE /identity/v3/users/f6698c1613af4d218875192c98ea3e31 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:23.256859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:23.257153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:23.257433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:23.278977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:23.280220 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:23.352655 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1132/2268] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:23.362345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:23.363727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:23.440372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77c408-d114-4905-b670-019f818ef9f3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:23.445675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:23.446321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:23.446606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:23.446886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:23.456370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:23.457882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d7ceb-4ccd-4886-956a-e90d66e75c3a service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:23.469618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1137/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:23.933860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:23.937854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:23.954291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb9112-5e0e-463d-8b3a-981bbec996c8 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:23.959781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:23.961462 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:23.961944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:23.962407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] PATH_INFO: `/v3/projects/bf6655740c8f4049ae3338a298cc1d3b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:23.964075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6655740c8f4049ae3338a298cc1d3b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:23.966413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.042266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6655740c8f4049ae3338a298cc1d3b', 'request_id': 'req-c733ec2a-01ff-4292-8b07-773c4e22a18f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:24.052180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6655740c8f4049ae3338a298cc1d3b', 'request_id': 'req-c733ec2a-01ff-4292-8b07-773c4e22a18f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:24.058522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6655740c8f4049ae3338a298cc1d3b', 'request_id': 'req-c733ec2a-01ff-4292-8b07-773c4e22a18f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:24.071709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] The token cache is being invalidate because project bf6655740c8f4049ae3338a298cc1d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:24.071999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:24.072632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c733ec2a-01ff-4292-8b07-773c4e22a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:24.074429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1133/2270] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:23 2022] DELETE /identity/v3/projects/bf6655740c8f4049ae3338a298cc1d3b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:24.079098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.079679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.079810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.098595 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:24.099840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:24.118531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:24.170033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1138/2271] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:24.178663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.178889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.179173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.198681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:24.199965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:24.210040 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1134/2272] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:24.214271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.230633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a023-6a46-4b28-83cc-e77522e196f0 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.236410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.237491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.237795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.238075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.238854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:24.239273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.242795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.264725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1139/2273] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:24.269038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.281798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d8ea-c63e-411d-b437-9aa472f9dc09 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.286503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.287162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.287469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.287789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.288503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.290463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.324258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1135/2274] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:24 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:24.328004 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.338943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec053c6-b343-4eca-983a-7454655dccdb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.409744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.410735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.411054 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.411417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.412218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.415026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.439912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1140/2275] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:24 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:24.444606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.455642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55751-c555-44c0-809d-e726e132787f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.463274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.463986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.464273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.464717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.465454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.467070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.484170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1136/2276] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:24.486048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.499410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748559f-d3af-4941-b7c7-7fcc78861d58 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.505684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.506398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.506723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.507053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.507875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.509585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892c7cd-3854-4d3d-a5e0-daf6bcb9c839 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.520366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1141/2277] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:24.524722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.535115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a033a-3b1f-441e-92f8-1091aebb13d8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.541556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.542566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.542931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.543262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] PATH_INFO: `/v3/projects/3761651d4999477eb8af200df118bef2/users/371665b022464e1eb7ac756a2ee61d3c/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.560478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3761651d4999477eb8af200df118bef2, user_id=371665b022464e1eb7ac756a2ee61d3c, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.563182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.593972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1137/2278] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:24 2022] PUT /identity/v3/projects/3761651d4999477eb8af200df118bef2/users/371665b022464e1eb7ac756a2ee61d3c/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:24.596115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55421476-f723-4717-809b-73985f661aae None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.596409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55421476-f723-4717-809b-73985f661aae None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.596904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55421476-f723-4717-809b-73985f661aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.634364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-55421476-f723-4717-809b-73985f661aae None None] MFA Rules not processed for user `371665b022464e1eb7ac756a2ee61d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:24.635745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-55421476-f723-4717-809b-73985f661aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:24.717480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1142/2279] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:24.728010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:24.730179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:24.754413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:24.793691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d742319-a148-4150-8ebb-eb4e1d095e17 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:24.797507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:24.798157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:24.798444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:24.798725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:24.809127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:24.810568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd143c-80c0-47eb-b1eb-e31f2852cf18 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:24.820771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1138/2280] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:25.433106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71c34-bf83-4745-ae54-bc9d673cb406 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:25.433628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71c34-bf83-4745-ae54-bc9d673cb406 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:25.433720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71c34-bf83-4745-ae54-bc9d673cb406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:25.451566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-daa71c34-bf83-4745-ae54-bc9d673cb406 None None] MFA Rules not processed for user `dd16ace77d1946a187cd05183de30e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:25.452764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-daa71c34-bf83-4745-ae54-bc9d673cb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:25.465372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:25.512646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1143/2281] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:27.303280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da786-8405-4233-b661-86a226451007 None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.304905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da786-8405-4233-b661-86a226451007 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.305194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54da786-8405-4233-b661-86a226451007 None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.306703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1139/2282] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:07:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:07:27.317728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.318212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.318508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.337412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] MFA Rules not processed for user `90fb8c894b484ab1b739d5e8e6dec3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:27.339281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:27.384197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54da786-8405-4233-b661-86a226451007 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:27.385897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a54da786-8405-4233-b661-86a226451007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:27.439902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1144/2283] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:07:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:27.451363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:27.452724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:27.459075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54da786-8405-4233-b661-86a226451007 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:27.466035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:27.466267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c3df2-0e90-4626-887e-8e09b4a52162 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:27.466918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.467203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.467481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] PATH_INFO: `/v3/users/56ca9bbe23f84a99b674e0c36d923dec` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.468732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ca9bbe23f84a99b674e0c36d923dec)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:27.470755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:27.471081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:27.471750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.472029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.472302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.481292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:27.482855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:27.493752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1145/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:07:27.522489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ca9bbe23f84a99b674e0c36d923dec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.536570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ca9bbe23f84a99b674e0c36d923dec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.537377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ca9bbe23f84a99b674e0c36d923dec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.537997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ca9bbe23f84a99b674e0c36d923dec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.545903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ca9bbe23f84a99b674e0c36d923dec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.560868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1140/2285] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:27 2022] DELETE /identity/v3/users/56ca9bbe23f84a99b674e0c36d923dec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:07:27.737502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:27.755292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcbc5-ed4f-49eb-9ddd-9d9462d42708 service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:27.814705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:27.815577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.815856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.816126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] PATH_INFO: `/v3/projects/f4df022e4edb480c8507f921ca0a96a6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.817268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4df022e4edb480c8507f921ca0a96a6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:27.819194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:27.871220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:27.872624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4df022e4edb480c8507f921ca0a96a6', 'request_id': 'req-f22c5e82-5e86-45e2-8a99-9971f2a13865'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.882312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4df022e4edb480c8507f921ca0a96a6', 'request_id': 'req-f22c5e82-5e86-45e2-8a99-9971f2a13865'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.888800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4df022e4edb480c8507f921ca0a96a6', 'request_id': 'req-f22c5e82-5e86-45e2-8a99-9971f2a13865'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.899874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] The token cache is being invalidate because project f4df022e4edb480c8507f921ca0a96a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:27.900162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.900832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:27.902378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1146/2286] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:27 2022] DELETE /identity/v3/projects/f4df022e4edb480c8507f921ca0a96a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:27.906365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:27.907804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:27.920632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9f289-e6a5-46fb-926c-0525f5b4dbad admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:27.967477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:27.985500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:27.986295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:27.986585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:27.986864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] PATH_INFO: `/v3/users/ee592a01e88d4246b888257081faf3f6` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:27.988099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee592a01e88d4246b888257081faf3f6)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:27.990039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.038512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee592a01e88d4246b888257081faf3f6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.051467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee592a01e88d4246b888257081faf3f6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.052233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee592a01e88d4246b888257081faf3f6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.052842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee592a01e88d4246b888257081faf3f6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.061343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-17ebd375-e473-4f14-936e-93010ab177a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee592a01e88d4246b888257081faf3f6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.074230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1141/2287] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:27 2022] DELETE /identity/v3/users/ee592a01e88d4246b888257081faf3f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:28.253338 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.254806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:28.269790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c5e82-5e86-45e2-8a99-9971f2a13865 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.332475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.333358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.333635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.334172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] PATH_INFO: `/v3/projects/308ff1af7a394e56b062f62a39674fff` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.335602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308ff1af7a394e56b062f62a39674fff)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.337479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.383330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308ff1af7a394e56b062f62a39674fff', 'request_id': 'req-eb297bbf-9003-4961-bc82-ba9286a9b6f1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.391147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308ff1af7a394e56b062f62a39674fff', 'request_id': 'req-eb297bbf-9003-4961-bc82-ba9286a9b6f1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.397120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308ff1af7a394e56b062f62a39674fff', 'request_id': 'req-eb297bbf-9003-4961-bc82-ba9286a9b6f1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.408017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] The token cache is being invalidate because project 308ff1af7a394e56b062f62a39674fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:28.408298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.408922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-eb297bbf-9003-4961-bc82-ba9286a9b6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:28.410479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1147/2288] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:28 2022] DELETE /identity/v3/projects/308ff1af7a394e56b062f62a39674fff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:28.415903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.416366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.416498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.435694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:28.436954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:28.502954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1142/2289] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:28.510433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.510742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.511050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.530081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:28.531290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:28.540063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1148/2290] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:28.544527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.554180 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4b40a-ee95-464b-b170-2dfd7e4eecf9 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.558787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.559906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.559906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.560201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.560927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:28.561258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.562882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.574998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1143/2291] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:28.579399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.589632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79961ae-019c-4f55-930f-adc6beb3a057 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.594454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.595099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.595376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.595677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.596361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.598255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.624791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1149/2292] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:28 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:28.629095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.639107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb847-51eb-4d63-bb30-73cbce59ca7d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.683345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:28.698492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.699168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.699456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.699782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.700490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.702444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.723624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1144/2293] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:28 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:28.728741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.739456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e663-f178-4dc2-b0eb-3863f0eb9f8d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.744197 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.744861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.745144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.745426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.746152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.747898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.766207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1150/2294] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:28.770794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.781521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8078e-4a7e-4db8-8946-5efa72a53096 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.786140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.786827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.787114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.787396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.788163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.790375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0e87b-4d56-4ffc-b049-24008d6dc44f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.800420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1145/2295] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:28.804744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.815939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee248d-a1cc-4ece-aac8-8ef17666a133 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:28.822019 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:28.822919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.823199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.823474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] PATH_INFO: `/v3/projects/ad9414220c224e009c6c3a10bd3c2f3f/users/c71c35e7e13c4a48ba3d9d100f5d30af/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.839253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9414220c224e009c6c3a10bd3c2f3f, user_id=c71c35e7e13c4a48ba3d9d100f5d30af, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:28.841990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:28.857782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1151/2296] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:28 2022] PUT /identity/v3/projects/ad9414220c224e009c6c3a10bd3c2f3f/users/c71c35e7e13c4a48ba3d9d100f5d30af/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:28.867236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:28.867826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:28.868350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:28.896620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] MFA Rules not processed for user `c71c35e7e13c4a48ba3d9d100f5d30af`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:28.898093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:28.962521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1146/2297] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:28.974011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:28.975859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:28.981480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:29.037803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb0d9c-9951-4a8f-8e20-4e75d28a3f46 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:29.041376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:29.042009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:29.042292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:29.042568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:29.050674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:29.052140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22828f8-2d7e-4046-92f0-d293c31b89e3 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:29.061778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1152/2298] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:31.681535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:31.769904 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c308fab-e308-4319-94af-73dab1c2c27f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:31.778504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:31.779735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:31.780820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:31.781288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] PATH_INFO: `/v3/users/c71c35e7e13c4a48ba3d9d100f5d30af` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:31.784017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71c35e7e13c4a48ba3d9d100f5d30af)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:31.786306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:31.855566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71c35e7e13c4a48ba3d9d100f5d30af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:31.866309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:31.875743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71c35e7e13c4a48ba3d9d100f5d30af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:31.876347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71c35e7e13c4a48ba3d9d100f5d30af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:31.877252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71c35e7e13c4a48ba3d9d100f5d30af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:31.893179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71c35e7e13c4a48ba3d9d100f5d30af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:31.911840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1147/2299] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:31 2022] DELETE /identity/v3/users/c71c35e7e13c4a48ba3d9d100f5d30af => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:31.913843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:31.914559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:31.915008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:31.946012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:31.947830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:32.035006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1153/2300] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:32.050420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.051980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:32.116509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00a4a-0c46-4808-8a58-db58bd22ad65 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.120163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.120802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.121086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.121365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.130772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.132221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac51fa-c7e9-4a59-b974-cf2173a82d99 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.142403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1148/2301] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:32.403575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.405089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:32.416930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d1d3-0ead-4832-ac44-f2cd4248a832 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.421554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.422474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.422807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.423096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] PATH_INFO: `/v3/projects/ad9414220c224e009c6c3a10bd3c2f3f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.424415 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9414220c224e009c6c3a10bd3c2f3f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.426343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.474335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9414220c224e009c6c3a10bd3c2f3f', 'request_id': 'req-1de3f217-10f9-43a2-9b28-06c4a595f92c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:32.481352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9414220c224e009c6c3a10bd3c2f3f', 'request_id': 'req-1de3f217-10f9-43a2-9b28-06c4a595f92c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:32.486952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9414220c224e009c6c3a10bd3c2f3f', 'request_id': 'req-1de3f217-10f9-43a2-9b28-06c4a595f92c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:32.498320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] The token cache is being invalidate because project ad9414220c224e009c6c3a10bd3c2f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:32.498606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:32.499235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1de3f217-10f9-43a2-9b28-06c4a595f92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:32.500792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1154/2302] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:32 2022] DELETE /identity/v3/projects/ad9414220c224e009c6c3a10bd3c2f3f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:32.505551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.505845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.506125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.523865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:32.525058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:32.583547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1149/2303] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:32.591549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.591919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.592124 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.611129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:32.612373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:32.621024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1155/2304] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:32.625173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.636322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a986cd-b4b9-4136-9911-28f1de261e3d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.640878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.641528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.641815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.642095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.642825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:32.643133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.644902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.661377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1150/2305] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:32.668711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.678189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454dc5b-f19b-4305-b273-67637be4b1b7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.683663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.684325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.684609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.684885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.685582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.687768 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.720993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:32.735139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1156/2306] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:32 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:32.736265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.747331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab159f4-54d4-45f2-b9ef-124f524822dc admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.807219 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.807921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.808208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.808486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.809187 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.811096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.820737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:32.834346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1151/2307] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:32 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:32.837446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.847628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29314d93-ed81-4242-ad7d-2b0277bad638 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.853219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.854014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.854357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.854696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.855429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.857050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.869834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1157/2308] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:32.874102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.885445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aecdbb-7abb-49b2-947c-9684085ec5c9 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.891011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.891882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.892181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.892531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.893282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.895073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782c7c6-6ba2-42d1-83b7-937192ff0dad admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.909939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1152/2309] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:07:32.911111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:32.922115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcd0b3-1edc-40a7-bf18-c7d720bcc874 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:32.927052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:32.927972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.928258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.928538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] PATH_INFO: `/v3/projects/04ee5ceed3ff43d7ab276fea258c5b40/users/bf725c11b21148d3b6b7d6ffefa5600d/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:32.946258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ee5ceed3ff43d7ab276fea258c5b40, user_id=bf725c11b21148d3b6b7d6ffefa5600d, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:32.948969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:32.963128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1158/2310] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:32 2022] PUT /identity/v3/projects/04ee5ceed3ff43d7ab276fea258c5b40/users/bf725c11b21148d3b6b7d6ffefa5600d/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:32.973411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:32.973708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:32.974063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:33.008378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] MFA Rules not processed for user `bf725c11b21148d3b6b7d6ffefa5600d`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:33.009953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:33.080385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1153/2311] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:33.092780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:33.094592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:33.156356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0621d-6a1e-415f-8d66-89dd4710fa6f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:33.159895 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:33.160528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:33.160807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:33.161107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:33.169794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:33.171223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a4957-8acc-43b2-b3c3-5ce4ddac0222 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:33.179811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1159/2312] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:42.629496 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:42.630967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:42.694693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350942c4-b814-45dd-9c15-1bc2512f4b95 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:42.699973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:42.700830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:42.701105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:42.701379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] PATH_INFO: `/v3/users/35a18c9cade44c5d95877c5c1b9130eb` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:42.702556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a18c9cade44c5d95877c5c1b9130eb)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:42.704509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:42.748880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a18c9cade44c5d95877c5c1b9130eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:42.760923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a18c9cade44c5d95877c5c1b9130eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:42.761588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a18c9cade44c5d95877c5c1b9130eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:42.762214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a18c9cade44c5d95877c5c1b9130eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:42.769193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a18c9cade44c5d95877c5c1b9130eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:42.773688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:42.783017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1154/2313] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:42 2022] DELETE /identity/v3/users/35a18c9cade44c5d95877c5c1b9130eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:42.787650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:42.788150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:42.788250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:42.804862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:42.806572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:42.864796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1160/2314] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:42.875128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:42.876568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:42.937787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0638-5d37-4a71-a45c-27a2705e529a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:42.955828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:42.956664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:42.957405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:42.957673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:42.974033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:42.976660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeee8a-2042-4675-9aac-860c8a46e9eb service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:42.991839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1155/2315] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:43.717592 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:43.719024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:43.731309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12525387-0ff7-4e04-902e-31c9f567ab39 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:43.737937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:43.738807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:43.739096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:43.739573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] PATH_INFO: `/v3/projects/e5da48c04ece4458a69ad6145d767122` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:43.741616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5da48c04ece4458a69ad6145d767122)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:43.744036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:43.797755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5da48c04ece4458a69ad6145d767122', 'request_id': 'req-fae5fa5d-257a-4d13-8da7-b8e54317443e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:43.805032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5da48c04ece4458a69ad6145d767122', 'request_id': 'req-fae5fa5d-257a-4d13-8da7-b8e54317443e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:43.809773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:43.811024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5da48c04ece4458a69ad6145d767122', 'request_id': 'req-fae5fa5d-257a-4d13-8da7-b8e54317443e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:43.823893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] The token cache is being invalidate because project e5da48c04ece4458a69ad6145d767122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:43.824182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:43.824829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-fae5fa5d-257a-4d13-8da7-b8e54317443e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:43.826377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1161/2316] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:43 2022] DELETE /identity/v3/projects/e5da48c04ece4458a69ad6145d767122 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:43.831417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:43.831895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:43.831987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:43.850125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:43.851334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:43.912102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1156/2317] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:07:43.919947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:43.920237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:43.920513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:43.939406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:43.940651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:43.949794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1162/2318] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:43.954001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:43.965297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b969-85dc-4f88-8aab-7e071b86b4af None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:43.971456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:43.972272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:43.972622 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:43.973166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:43.974564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:07:43.975137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:43.976865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:43.988995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1157/2319] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:07:43.993519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.003194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95875-daa6-4314-90f6-266488960db8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.008305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.009570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.009972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.010514 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.011204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.013444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.042253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1163/2320] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:07:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:07:44.046153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.058525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e22-ff29-4b65-9a95-d2ef8351f0e2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.120031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.120695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.120977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.121254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.121940 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.125395 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.155387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1158/2321] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:07:44 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:07:44.159133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.169787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0b6-3f41-44f5-89ef-94ac6c6d7dd7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.181376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.182406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.182876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.183348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.184126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.185775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.215219 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1164/2322] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:07:44.219905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.235126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d076-8716-401f-bea7-ce8429e08b19 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.239836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.240453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.240732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.241019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.241723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.243883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54667-dd36-4886-a5c5-82756324b1ef admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.254735 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1159/2323] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:07:44.260320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.273367 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6667d1-42cf-4a88-bec1-93cd86dd97f3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.278560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.279437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.279773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.280071 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] PATH_INFO: `/v3/projects/232dc6c8059049b383e69255f3dcf117/users/42cc75474aad4fa19ccc9e87b45cb307/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.297299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232dc6c8059049b383e69255f3dcf117, user_id=42cc75474aad4fa19ccc9e87b45cb307, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.300284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.323335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1165/2324] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:07:44 2022] PUT /identity/v3/projects/232dc6c8059049b383e69255f3dcf117/users/42cc75474aad4fa19ccc9e87b45cb307/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:44.333786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.334078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.334356 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.340486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:44.363781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] MFA Rules not processed for user `42cc75474aad4fa19ccc9e87b45cb307`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:44.364985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:44.428748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1160/2325] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:44.440231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.441930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:44.499787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303a41-faf0-4bad-937c-6a202b620fd7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.503616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.504268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.504556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.504836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.514224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.515731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c690a-70e0-4ae8-b8ea-d3ddc9cc5e25 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.524798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1166/2326] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:44.720619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:44.722102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:44.794081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbf908-04be-42eb-9b80-df05cabd9633 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:44.798444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:44.799303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.799623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.799903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] PATH_INFO: `/v3/users/371665b022464e1eb7ac756a2ee61d3c` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.801083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] RBAC: Authorizing `identity:delete_user(user_id=371665b022464e1eb7ac756a2ee61d3c)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:44.803031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:44.855945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371665b022464e1eb7ac756a2ee61d3c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:44.876323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371665b022464e1eb7ac756a2ee61d3c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:44.877065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371665b022464e1eb7ac756a2ee61d3c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:44.877679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371665b022464e1eb7ac756a2ee61d3c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:44.886184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371665b022464e1eb7ac756a2ee61d3c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:44.903079 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1161/2327] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:44 2022] DELETE /identity/v3/users/371665b022464e1eb7ac756a2ee61d3c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:44.909635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:44.910093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:44.910494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:44.928529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:44.929760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:44.993825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1167/2328] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:07:45.003424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:45.004908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:45.018414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:45.063445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163116-cf6d-4fcf-9cd1-74a97a13589e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:45.067051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:45.067711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:45.067994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:45.068271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:45.077189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:45.078553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233ce2-3eba-43a9-b2be-afb6e7edcc40 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:45.088970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1162/2329] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:07:45.361232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:45.362704 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:45.381117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f10ca-9eef-4277-b060-0d66c985033c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:45.386512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:45.387568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:45.387852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:45.388133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] PATH_INFO: `/v3/projects/3761651d4999477eb8af200df118bef2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:45.389374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3761651d4999477eb8af200df118bef2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:07:45.391294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:07:45.423686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:45.441937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3761651d4999477eb8af200df118bef2', 'request_id': 'req-88914bd9-aeb0-4683-a335-062238a2ea29'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:45.449926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3761651d4999477eb8af200df118bef2', 'request_id': 'req-88914bd9-aeb0-4683-a335-062238a2ea29'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:45.455708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3761651d4999477eb8af200df118bef2', 'request_id': 'req-88914bd9-aeb0-4683-a335-062238a2ea29'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:45.467951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] The token cache is being invalidate because project 3761651d4999477eb8af200df118bef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:07:45.468257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:45.469136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:07:45.470900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1168/2330] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:07:45 2022] DELETE /identity/v3/projects/3761651d4999477eb8af200df118bef2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:07:55.084049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=21 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:55.468871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:07:59.865836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:59.866729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:59.867039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:59.895544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:07:59.896570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:07:59.897866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:59.898161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:07:59.981861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914bd9-aeb0-4683-a335-062238a2ea29 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:07:59.991568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:07:59.993185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:07:59.993640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:07:59.994069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] PATH_INFO: `/v3/users/db7a794936034d3c86195edde18afb3f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:07:59.995422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7a794936034d3c86195edde18afb3f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:00.003070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:00.005958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1163/2331] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:00.062362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:00.064199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:00.071878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7a794936034d3c86195edde18afb3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:00.072721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7a794936034d3c86195edde18afb3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:00.073647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7a794936034d3c86195edde18afb3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:00.086629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7a794936034d3c86195edde18afb3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:00.108606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ef9b0bf2-dabb-4f8d-aff4-0eb17e2515c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7a794936034d3c86195edde18afb3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:00.125876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1169/2332] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:07:59 2022] DELETE /identity/v3/users/db7a794936034d3c86195edde18afb3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:08:00.131137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:00.131497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:00.131885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:00.152427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:00.153653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:00.175192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57153ad2-e2dd-4721-9ade-c3cbde4ae99d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:00.234889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1170/2333] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:08:00.251813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:00.253384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:00.270956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:00.271652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:00.271939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:00.272217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:00.274156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:00.279855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:00.356315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:00.368074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddeac6-d7d8-4450-975e-eb30f05da332 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:00.375910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:00.378929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:00.379431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:00.379742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:00.380618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:00.382554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:00.398465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1164/2334] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:00.402770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:00.404626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa395f-9b40-47a4-8370-a9f3b7c64e02 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:00.428148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1171/2335] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:08:00.933084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:00.934442 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:00.968048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d68ff-2c6b-4bea-8037-bfa3837f0d5b service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:00.978039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:00.979631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:00.980832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:00.981435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] PATH_INFO: `/v3/projects/54aa38ae2a1e4c27b5f03f7eff8dac4e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:00.983135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=54aa38ae2a1e4c27b5f03f7eff8dac4e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:00.987003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.122630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54aa38ae2a1e4c27b5f03f7eff8dac4e', 'request_id': 'req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.143055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54aa38ae2a1e4c27b5f03f7eff8dac4e', 'request_id': 'req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.158454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54aa38ae2a1e4c27b5f03f7eff8dac4e', 'request_id': 'req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.196085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] The token cache is being invalidate because project 54aa38ae2a1e4c27b5f03f7eff8dac4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:08:01.198274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.199730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.209314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1165/2336] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:08:00 2022] DELETE /identity/v3/projects/54aa38ae2a1e4c27b5f03f7eff8dac4e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:01.214663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de613-8d2e-49b3-ab0a-f72caeced11f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.215708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de613-8d2e-49b3-ab0a-f72caeced11f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.216373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de613-8d2e-49b3-ab0a-f72caeced11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.273095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-524de613-8d2e-49b3-ab0a-f72caeced11f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:01.275561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-524de613-8d2e-49b3-ab0a-f72caeced11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.423051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.424546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1172/2337] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:01.424691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.432524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.432960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.433334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.443128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee69cf-55b6-490e-b810-ba0d5c9ce3de admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.472802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:01.474519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.485263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.486497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.486926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.487344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] PATH_INFO: `/v3/users/42cc75474aad4fa19ccc9e87b45cb307` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.488773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1173/2338] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:01.489957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cc75474aad4fa19ccc9e87b45cb307)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.490898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.493081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.514445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c7010-cdac-42e2-a48a-b86ec88ba283 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.519091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.519998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.520279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.520554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.521375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:08:01.521684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.523454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.539892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1174/2339] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:08:01.544105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.556614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1133c-b089-4631-aad0-82f04bd6d462 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.561462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.562129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.564890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.564890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.564890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.565846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.591492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cc75474aad4fa19ccc9e87b45cb307'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.604528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1175/2340] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:08:01 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:01.608288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.614880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cc75474aad4fa19ccc9e87b45cb307'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.615818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cc75474aad4fa19ccc9e87b45cb307'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.616538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cc75474aad4fa19ccc9e87b45cb307'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.629792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ef52508b-d99b-4459-a332-f25883fc702a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cc75474aad4fa19ccc9e87b45cb307'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:01.668779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1166/2341] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:08:01 2022] DELETE /identity/v3/users/42cc75474aad4fa19ccc9e87b45cb307 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:01.670688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.670688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.670935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.696707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:01.697651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.731650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed186cc-f42c-4fa2-9e41-f946245eac3b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.792901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:01.794725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:01.839754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1167/2342] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:01.853647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.856693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.893856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.894690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.895356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.895749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.896546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.898826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.936765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1176/2343] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:08:01 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:08:01.937851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:01.940677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:01.956281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0bbd-2dad-4a1c-91e8-03cd8b010b25 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.959993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6bd8b-db28-4e0e-aebd-bff7abade039 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:01.961303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.962061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.962460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.962838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.964966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:01.965622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:01.965901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:01.966180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:01.966901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.970540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.977880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:01.979573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:01.991669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1177/2344] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:01.993438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:02.001818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1168/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:02.011622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b69101-6e36-40bf-931e-95e787277db4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:02.021377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:02.022060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.022343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.022620 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.023563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:02.028656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6a90-8808-460e-acc3-092fdf2a0f0c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:02.045222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1178/2346] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:08:02.046520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:02.058733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157c608-45ce-4013-8fd4-e6809c09c143 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:02.066822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:02.067930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.068340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.070113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] PATH_INFO: `/v3/projects/8b8cba29e73c469d924aeaf9db1857e0/users/4ff924af30074a92960aace363617dea/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.096444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8cba29e73c469d924aeaf9db1857e0, user_id=4ff924af30074a92960aace363617dea, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:02.099721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:02.125503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1169/2347] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:02 2022] PUT /identity/v3/projects/8b8cba29e73c469d924aeaf9db1857e0/users/4ff924af30074a92960aace363617dea/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:02.132773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.133342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.133949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.160442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:02.162753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:02.296963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1179/2348] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:02.330975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:02.405406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c060b4-31a6-4419-ac5a-366defba288b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:02.409350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:02.410105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.410495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.410951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.431569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:02.433343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0241-b5db-4dcf-8e50-62b2aa4090f9 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:02.447193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1170/2349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:02.670983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:02.674375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:02.687285 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73324c-5a1b-459c-bde4-294ef9f9d63c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:02.697647 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:02.699017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.699541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.699857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] PATH_INFO: `/v3/projects/232dc6c8059049b383e69255f3dcf117` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.701741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232dc6c8059049b383e69255f3dcf117)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:02.704012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:02.787558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232dc6c8059049b383e69255f3dcf117', 'request_id': 'req-181c8a9f-010a-444d-be50-b5efd57d4c39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:02.808648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232dc6c8059049b383e69255f3dcf117', 'request_id': 'req-181c8a9f-010a-444d-be50-b5efd57d4c39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:02.824497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232dc6c8059049b383e69255f3dcf117', 'request_id': 'req-181c8a9f-010a-444d-be50-b5efd57d4c39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:02.844100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] The token cache is being invalidate because project 232dc6c8059049b383e69255f3dcf117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:08:02.849977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:02.850892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-181c8a9f-010a-444d-be50-b5efd57d4c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:02.854668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1180/2350] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:08:02 2022] DELETE /identity/v3/projects/232dc6c8059049b383e69255f3dcf117 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:08:02.858966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:02.859260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:02.859569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:02.879301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:02.881164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:03.072497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1171/2351] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:03.080966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.081330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.081530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.136111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:03.142360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:03.177619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1181/2352] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:03.183155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.197006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f752c-2d03-4248-ac50-54e6dfa3a629 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.203112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.203827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.204113 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.205258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.206019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:08:03.206331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.208788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.211342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:03.238360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1172/2353] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:08:03.238969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.254804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeff98c-c184-45dc-b09e-de1fe86bc99e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.267345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.268425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.268880 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.269336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.270297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.272519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.301551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:03.343962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1182/2354] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:08:03 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:08:03.345591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.365337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24ef78-edc8-4986-b5b5-eb58fda78db4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.469665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.470348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.470630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.470903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.471616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.473542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.508642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1173/2355] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:08:03 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:03.513249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.528223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce53a2-508f-4518-8809-d4f6fa6e81a1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.560028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.561025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.561585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.561867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.577588 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.580384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.621272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1183/2356] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:03.624032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.638951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b435eb1-0f42-44be-8c5a-b665b7d602cb admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.652530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.653658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.654156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.657087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.658156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.660084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66483470-c22d-4083-82a5-a7f7bb99c8ce admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.698546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1174/2357] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:03.702762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:03.720624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8802a5-33cb-4458-82ff-f213fe0a2db5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:03.728552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:03.729558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.729920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.730272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] PATH_INFO: `/v3/projects/72d22677ecd548e08eb2b5bb1bbb31e0/users/09b47a2bfb26427f84cf6e76e14d622f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.770995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d22677ecd548e08eb2b5bb1bbb31e0, user_id=09b47a2bfb26427f84cf6e76e14d622f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:03.773328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:03.815870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1184/2358] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:03 2022] PUT /identity/v3/projects/72d22677ecd548e08eb2b5bb1bbb31e0/users/09b47a2bfb26427f84cf6e76e14d622f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:03.817939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d36d-e2d6-42c5-a7b0-f1e45f39bdf3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:03.818361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d36d-e2d6-42c5-a7b0-f1e45f39bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:03.818865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d36d-e2d6-42c5-a7b0-f1e45f39bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:03.855946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-7f46d36d-e2d6-42c5-a7b0-f1e45f39bdf3 None None] MFA Rules not processed for user `09b47a2bfb26427f84cf6e76e14d622f`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:03.857325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7f46d36d-e2d6-42c5-a7b0-f1e45f39bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:04.056863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1175/2359] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:04.065743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:04.067630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:04.206466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdd40-169d-4828-b203-5c8436c54087 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:04.214736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:04.215868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:04.216286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:04.216657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:04.233778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:04.236266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3a82d-f97a-434f-9a19-f5188b4b25ba service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:04.249939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1185/2360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:05.970596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:05.971089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:05.971089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:06.010962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] MFA Rules not processed for user `09b47a2bfb26427f84cf6e76e14d622f`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:06.012617 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:06.028242 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1176/2361] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:10.576656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:10.577142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:10.577326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:10.678165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] MFA Rules not processed for user `4ff924af30074a92960aace363617dea`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:10.679958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:10.875352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1186/2362] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:10.876495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:10.877974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:11.035976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:11.049277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4653-414b-4452-8ce7-a8172518e507 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.055467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.057862 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.058011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.059343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.061883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.065240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.175476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:11.178480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1177/2363] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:08:10 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:11.202669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e0182-eafc-4686-bf08-2985ee3a2403 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.274835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:11.292559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.293151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.293436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.293856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.294580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.296846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.321594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1187/2364] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:08:11 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:08:11.323173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:11.342566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4b0d-373a-43de-83cb-b98de179e837 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.348855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.349500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.349916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.350222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.351663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.353277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.370997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1178/2365] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:11.372650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:11.383964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b340-e7f7-439f-a9af-0e31fae4f402 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.389584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.390497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.391115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.391412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] PATH_INFO: `/v3/projects/7261e5603bcc46eab23d939845e3a7b7/users/f5e5d041aa764f61bb473d182b3b76d1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.411212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7261e5603bcc46eab23d939845e3a7b7, user_id=f5e5d041aa764f61bb473d182b3b76d1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.414611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.442084 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1188/2366] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:11 2022] PUT /identity/v3/projects/7261e5603bcc46eab23d939845e3a7b7/users/f5e5d041aa764f61bb473d182b3b76d1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:08:11.446578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:11.469839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c356f8-fdc2-4bc4-aba7-19bed8d5ec0b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.635608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.636330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.636616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.636900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.637650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.639351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ec08-73d9-4afe-992e-08aded312800 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.657404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1179/2367] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:08:11.659159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:11.671744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c256-d1b6-4b1e-a1ac-3653a23cf7b5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:11.685528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:11.686583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:11.686861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:11.687131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] PATH_INFO: `/v3/projects/7261e5603bcc46eab23d939845e3a7b7/users/f5e5d041aa764f61bb473d182b3b76d1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:11.690109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7261e5603bcc46eab23d939845e3a7b7, user_id=f5e5d041aa764f61bb473d182b3b76d1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:11.692567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:11.706812 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1189/2368] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:11 2022] PUT /identity/v3/projects/7261e5603bcc46eab23d939845e3a7b7/users/f5e5d041aa764f61bb473d182b3b76d1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:18.906519 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818f11-db39-497c-bf3a-530c4f496865 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:18.907740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818f11-db39-497c-bf3a-530c4f496865 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:18.908627 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818f11-db39-497c-bf3a-530c4f496865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:18.943089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ff818f11-db39-497c-bf3a-530c4f496865 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:18.945520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ff818f11-db39-497c-bf3a-530c4f496865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:19.097192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1180/2369] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:08:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:19.128098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:19.131855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:19.253690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fed13-2004-4ecb-9f43-cf7a4152701d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:19.261872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:19.262831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:19.263755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:19.264220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:19.279535 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:19.281828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:19.293860 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1190/2370] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:21.563651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:21.565003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:21.565534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:21.652428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] MFA Rules not processed for user `f5e5d041aa764f61bb473d182b3b76d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:21.654292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:21.828409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:21.883433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1181/2371] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:21.999303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:22.001753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:22.144906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fde38-75fd-4163-a50e-3e49b9631523 service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:22.151603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:22.152303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:22.152837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:22.153127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:22.202831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:22.246561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:22.248294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a887c-dfc3-4cce-9bb3-cc0ae9e09d49 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:22.259006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1191/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:22.799539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:22.801893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:23.102839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede60c-6f89-4a76-b513-da294a7a784d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:23.136555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:23.145337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:23.145337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:23.145337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] PATH_INFO: `/v3/users/bf725c11b21148d3b6b7d6ffefa5600d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:23.152986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf725c11b21148d3b6b7d6ffefa5600d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:23.162265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:23.300528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf725c11b21148d3b6b7d6ffefa5600d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:23.336139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf725c11b21148d3b6b7d6ffefa5600d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:23.336916 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf725c11b21148d3b6b7d6ffefa5600d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:23.337549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf725c11b21148d3b6b7d6ffefa5600d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:23.364115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf725c11b21148d3b6b7d6ffefa5600d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:23.401472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1182/2373] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:08:22 2022] DELETE /identity/v3/users/bf725c11b21148d3b6b7d6ffefa5600d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:23.406396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:23.406396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:23.407089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:23.477887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:23.479143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:23.619752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1192/2374] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:23.638297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:23.640063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:23.679707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:23.852643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d565f-db47-4d4e-8af0-4582b22d1391 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:23.866269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:23.867387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:23.868812 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:23.869347 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:23.890280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:23.893014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609d9a9-f2d3-4f10-9e33-f72e6f7bae98 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:23.934235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1183/2375] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:25.149160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:25.151062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:25.172937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f2175-6184-4806-9245-5f73151913c4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:25.187120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:25.190540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.191686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.191981 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] PATH_INFO: `/v3/projects/04ee5ceed3ff43d7ab276fea258c5b40` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.194916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ee5ceed3ff43d7ab276fea258c5b40)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:25.207333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:25.317251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30d95-2b22-4b7f-9060-94c1d605cb3a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.318285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30d95-2b22-4b7f-9060-94c1d605cb3a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.318779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30d95-2b22-4b7f-9060-94c1d605cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.341980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ee5ceed3ff43d7ab276fea258c5b40', 'request_id': 'req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:25.351952 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-64d30d95-2b22-4b7f-9060-94c1d605cb3a None None] MFA Rules not processed for user `4ff924af30074a92960aace363617dea`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:25.353651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-64d30d95-2b22-4b7f-9060-94c1d605cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:25.359002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ee5ceed3ff43d7ab276fea258c5b40', 'request_id': 'req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:25.371106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ee5ceed3ff43d7ab276fea258c5b40', 'request_id': 'req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:25.388127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] The token cache is being invalidate because project 04ee5ceed3ff43d7ab276fea258c5b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:08:25.388127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:25.388972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b2bf1ef3-63f0-497b-86d3-a41ae0f61bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:08:25.392262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1193/2376] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:08:25 2022] DELETE /identity/v3/projects/04ee5ceed3ff43d7ab276fea258c5b40 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:25.399485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.400175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.400667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.469040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:25.472412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:25.486267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1184/2377] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:08:25.527039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:25.601712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1194/2378] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:25.609444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.609943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.610340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.633712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:25.635423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:25.648011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1185/2379] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:25.651955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:25.676245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34eea-d396-41ca-9e5d-0eb3c7e1dee9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:25.686387 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:25.687296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.687737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.688119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.689496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:08:25.689919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:25.691977 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:25.708146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1195/2380] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:08:25.712751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:25.725874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2f45-0872-4181-9519-d6e1faa91101 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:25.738440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:25.740314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.742428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.742887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.743814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:25.750710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:25.822586 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1186/2381] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:08:25 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:25.825272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:25.838845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520804-e736-46f7-babf-eb77f95ebe9e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:25.940311 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:25.940999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:25.941286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:25.942082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:25.943552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:25.946211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:25.987002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1196/2382] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:08:25 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:25.990939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:26.012105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e25e0-a7ca-4af2-a69e-0b1a31fd1c5d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:26.017954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:26.018624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:26.019082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:26.019522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:26.020375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:26.022360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:26.038102 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1187/2383] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:26.042475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:26.057555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733a6e-fca4-443f-95b9-89d4e15a9c2c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:26.092267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:26.094708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:26.095360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:26.096056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:26.097003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:26.099181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08759f-4241-4527-950b-9a4970e5fbf4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:26.113864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1197/2384] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:26.118263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:26.132255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ec94b-7430-478b-8a19-3b1ae65c8715 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:26.147712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:26.148985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:26.149283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:26.149567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] PATH_INFO: `/v3/projects/dec23b88cdda4d7eb28bf33e9668aa7b/users/ff89ac1543214afd8df4a39fe934eb39/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:26.197587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec23b88cdda4d7eb28bf33e9668aa7b, user_id=ff89ac1543214afd8df4a39fe934eb39, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:26.205985 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:26.245715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1188/2385] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:26 2022] PUT /identity/v3/projects/dec23b88cdda4d7eb28bf33e9668aa7b/users/ff89ac1543214afd8df4a39fe934eb39/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:26.250303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e85-b31c-4a14-b93e-cce7c03c45a4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:26.250909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e85-b31c-4a14-b93e-cce7c03c45a4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:26.250909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201e85-b31c-4a14-b93e-cce7c03c45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:26.298554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f9201e85-b31c-4a14-b93e-cce7c03c45a4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:26.313997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f9201e85-b31c-4a14-b93e-cce7c03c45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:26.542969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1198/2386] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:26.553951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:26.555821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:26.615285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:26.729619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca125ada-ed6e-4eab-b2c1-1416b6dfbbad admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:26.738785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:26.739955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:26.740353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:26.740776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:26.783428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:26.787231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760987-13ef-4987-a0dc-4d8e7717dae8 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:26.841015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1189/2387] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:27.961096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf416-2e29-4635-aaa1-6b203dead34c None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:27.961627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf416-2e29-4635-aaa1-6b203dead34c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:27.961927 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf416-2e29-4635-aaa1-6b203dead34c None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:27.963771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1199/2388] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:08:27.979791 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:27.980821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:27.982608 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:28.030350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:28.031897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:28.196012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1190/2389] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:08:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:34.197087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.201618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.202412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.286831 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] MFA Rules not processed for user `ff89ac1543214afd8df4a39fe934eb39`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:34.288480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:34.319120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:34.380664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1200/2390] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:34.381778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:34.393581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6377f-b0c7-44ad-9c05-5bcf29487ef7 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:34.401002 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:34.402401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.402846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.406363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.407486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:34.409799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:34.455986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1191/2391] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:08:34 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:08:34.461382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:34.481018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793bc9-d572-40a5-91c4-c0f5a57f6823 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:34.595702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:34.596401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.596688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.598779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.599139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:34.604932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:34.670644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1201/2392] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:08:34 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:08:34.674212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:34.703970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215df6f-7452-4a51-aafe-8caead37cd7f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:34.728817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:34.729656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.730680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.737719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.741045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:34.745309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:34.773167 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1192/2393] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:34.776839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:34.790618 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d574a-ebba-4f71-90ee-0ff6d16ceb60 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:34.807301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:34.808696 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.808996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.809522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] PATH_INFO: `/v3/projects/e532bc5abdf6422f995087f1f3b88699/users/31933a72a39248b7b9970b913ff002e1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.844407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e532bc5abdf6422f995087f1f3b88699, user_id=31933a72a39248b7b9970b913ff002e1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:34.848497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:34.870312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1202/2394] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:34 2022] PUT /identity/v3/projects/e532bc5abdf6422f995087f1f3b88699/users/31933a72a39248b7b9970b913ff002e1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:34.874408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:34.886911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd770-f7f3-4da2-9064-ffa7bf66ac01 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:34.994968 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:34.995321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:34.996101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:34.996698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:34.997816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:35.000020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:35.027454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1193/2395] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:08:35.029400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:35.054267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3764c8-a06a-4a79-bc8d-8fa6af7b82e7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:35.062425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:35.063332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:35.063676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:35.064014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] PATH_INFO: `/v3/projects/e532bc5abdf6422f995087f1f3b88699/users/31933a72a39248b7b9970b913ff002e1/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:35.066688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e532bc5abdf6422f995087f1f3b88699, user_id=31933a72a39248b7b9970b913ff002e1, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:35.071136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01f3a-cdf6-4e61-8e13-37f928a11322 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:35.088625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1203/2396] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:08:35 2022] PUT /identity/v3/projects/e532bc5abdf6422f995087f1f3b88699/users/31933a72a39248b7b9970b913ff002e1/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:08:40.727262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:40.730031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:40.780058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:40.867397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439f30-85db-42a2-9012-a4b6e09ebd31 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:40.982447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:40.986479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:40.987790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:40.988539 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:41.131682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:41.133241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a134f2-d943-40c6-8281-6c591dee61fc service glance] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:41.172325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1194/2397] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:41.479238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0104-2491-411b-a19c-b7cbc91d7702 None None] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:41.479878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0104-2491-411b-a19c-b7cbc91d7702 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:41.480160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0104-2491-411b-a19c-b7cbc91d7702 None None] PATH_INFO: `/` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:41.481922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1204/2398] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:08:41.488613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:41.489185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:41.489699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:41.553241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:41.553655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:41.554038 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:41.589429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:41.591346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] MFA Rules not processed for user `1d7e8acb91804c358b40c90faa233296`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:41.592585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:41.592879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:41.783804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1205/2399] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:08:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:08:41.793894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1195/2400] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:08:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:41.803717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:41.808504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:41.816830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:41.827550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fc8e2-54c1-436b-922b-02da5e829b20 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:41.833862 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:41.834669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:41.835137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:41.835584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:41.843404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:41.846566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:41.848544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e41298-1410-4c95-b348-173caa5757d9 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:41.860810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1196/2401] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:08:41.893796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:42.017546 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7b15a-8a5a-47cf-94e3-a590ae98ba9d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:42.046235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:42.046923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:42.047208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:42.047486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:42.071533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:42.073846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab65788-d138-426e-9e0a-4410003a3c00 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:42.085314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1206/2402] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:42.127474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d164-ef8f-4bbc-ad7c-0a1adfd7d01c None None] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:42.128656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d164-ef8f-4bbc-ad7c-0a1adfd7d01c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:42.129254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76d164-ef8f-4bbc-ad7c-0a1adfd7d01c None None] PATH_INFO: `/` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:42.131120 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1197/2403] 10.222.0.13 () {54 vars in 921 bytes} [Wed Jun 22 06:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 06:08:42.138284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea309d-735c-4340-bbf3-5cd6e88529e1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:42.138926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea309d-735c-4340-bbf3-5cd6e88529e1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:42.139229 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea309d-735c-4340-bbf3-5cd6e88529e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:42.164586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-bcea309d-735c-4340-bbf3-5cd6e88529e1 None None] MFA Rules not processed for user `217be31925ad4d859522dce86af2ca45`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:42.166453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bcea309d-735c-4340-bbf3-5cd6e88529e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:42.193887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1207/2404] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Jun 22 06:08:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:42.235281 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76d164-ef8f-4bbc-ad7c-0a1adfd7d01c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:42.265769 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76d164-ef8f-4bbc-ad7c-0a1adfd7d01c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:42.283492 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:42.284294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:42.284590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:42.284875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:42.329701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:42.356274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cc63f-59d1-41b8-93a0-b78924db951d service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:42.420554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1198/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:43.543235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:43.544443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:43.544933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:43.643420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] MFA Rules not processed for user `31933a72a39248b7b9970b913ff002e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:43.646263 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:43.844425 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1208/2406] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:43.893777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:43.894344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:43.894344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:43.963208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:43.966616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:43.985615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1199/2407] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:08:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:44.016147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:44.034490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d38af4-a980-4ca2-b205-e80981fd0e75 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:44.046807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:44.047788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:44.048790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:44.049230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:44.068852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:44.070669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a8fd7-2b60-4533-97d7-e0d448d65840 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:44.088456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1209/2408] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:44.304963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:44.316854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d4f5-d2dd-46c9-84bf-996b3314ec6d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:44.323835 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6d629e689d45d4b28b24b7f3d0d3d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:44.324569 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:44.330485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:44.331064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:44.405041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:44.406884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:44.421813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1200/2409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:44.612672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:44.617098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:44.617714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:44.638098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:44.639912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:44.662730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1210/2410] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:08:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:08:44.680903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:44.695860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a50b-8281-4447-aea9-d033fec4f857 service glance] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:44.703261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:44.704095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:44.704531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:44.704809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:44.729878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:44.732152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95613-4251-4fa1-aa19-be4fd7b8a5c3 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:44.749856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1201/2411] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:45.242244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:45.243806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:45.427472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:08:45.482755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed06765-e4b0-4f6b-a9b3-9ff236887dcb None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:45.498842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:45.499815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:45.500202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:45.500597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:45.507103 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:45.535093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:45.537411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:45.559736 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1211/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:08:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:08:48.841714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf212-f2c4-4706-9bfa-07c219787408 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:48.842270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf212-f2c4-4706-9bfa-07c219787408 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:48.842633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf212-f2c4-4706-9bfa-07c219787408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:48.894487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-579cf212-f2c4-4706-9bfa-07c219787408 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:48.896265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-579cf212-f2c4-4706-9bfa-07c219787408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:48.910999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1202/2413] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:08:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:48.944649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:48.988525 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af3e2d-9b5e-4372-ab2e-5e737725f3cd service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:49.021186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:49.025431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:49.025682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:49.025967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:49.056074 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:49.057152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:49.081114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1212/2414] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:49.841794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229db57-29bf-4b24-aa80-d68d9b30ccd4 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:49.847275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229db57-29bf-4b24-aa80-d68d9b30ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:49.847850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229db57-29bf-4b24-aa80-d68d9b30ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:49.946349 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8229db57-29bf-4b24-aa80-d68d9b30ccd4 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:49.952866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8229db57-29bf-4b24-aa80-d68d9b30ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:49.965991 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1203/2415] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:08:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:49.984020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:49.995994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fff99-10f3-4669-95f2-93980861056f service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:50.003609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:50.004516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:50.005050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:50.005545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:50.020605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:50.022782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa6bc-ca30-492c-b3ba-3df232ceb1c9 service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:50.062809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1213/2416] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:58.653547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:58.654457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:58.654698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:58.675036 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dff5-1efd-40bd-8190-329c0667a932 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:58.675633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dff5-1efd-40bd-8190-329c0667a932 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:58.675633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dff5-1efd-40bd-8190-329c0667a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:58.677886 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] MFA Rules not processed for user `ff89ac1543214afd8df4a39fe934eb39`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:58.679653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:58.708895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1204/2417] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:08:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:58.718691 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1093dff5-1efd-40bd-8190-329c0667a932 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:58.722811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1093dff5-1efd-40bd-8190-329c0667a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:58.747969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1214/2418] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:08:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:08:58.769461 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:58.789482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cfc3c-fe26-43e3-80bc-d294593234c1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:58.795793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:58.796709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:58.797162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:58.797603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:58.807865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:58.809786 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:58.821373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1205/2419] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:08:59.691808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:59.692904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:59.693115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:59.715365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:08:59.717807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:08:59.734529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1215/2420] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:08:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:08:59.766754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:08:59.783277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e79861-973b-47e2-bb4a-f0e80f58106a service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:08:59.796105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:08:59.796852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:08:59.797136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:08:59.797443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:08:59.811996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:08:59.815650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:08:59.830267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1206/2421] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:09:01.779634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:01.784257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:01.876416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9016e-d859-4175-8a42-b548dbd0d712 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:01.881119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:01.882010 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:01.882533 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:01.883006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] PATH_INFO: `/v3/users/dd16ace77d1946a187cd05183de30e4a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:01.884432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd16ace77d1946a187cd05183de30e4a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:01.886527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:01.938808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd16ace77d1946a187cd05183de30e4a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:01.939463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd16ace77d1946a187cd05183de30e4a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:01.943904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd16ace77d1946a187cd05183de30e4a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:01.952050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd16ace77d1946a187cd05183de30e4a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:01.970821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd16ace77d1946a187cd05183de30e4a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:01.984917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1216/2422] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:09:01 2022] DELETE /identity/v3/users/dd16ace77d1946a187cd05183de30e4a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:09:02.163854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:02.175821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844fc43-dc3b-4215-b3d3-035bd1a61345 service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:02.240027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:02.240872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:02.241301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:02.241616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] PATH_INFO: `/v3/projects/8b3fb936e4ee49f1a3df208f0b32cc80` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:02.242802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3fb936e4ee49f1a3df208f0b32cc80)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:02.244784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:02.261269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:02.291819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3fb936e4ee49f1a3df208f0b32cc80', 'request_id': 'req-9e5604eb-5db5-45bc-aa03-f714b8903edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.300076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3fb936e4ee49f1a3df208f0b32cc80', 'request_id': 'req-9e5604eb-5db5-45bc-aa03-f714b8903edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.307083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3fb936e4ee49f1a3df208f0b32cc80', 'request_id': 'req-9e5604eb-5db5-45bc-aa03-f714b8903edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.325477 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] The token cache is being invalidate because project 8b3fb936e4ee49f1a3df208f0b32cc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:09:02.326297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.327140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-9e5604eb-5db5-45bc-aa03-f714b8903edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.337649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1207/2423] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:09:02 2022] DELETE /identity/v3/projects/8b3fb936e4ee49f1a3df208f0b32cc80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:09:02.595183 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:02.596629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:02.610339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc752-4c61-4c84-9870-3f5feb56ae1c admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:02.624033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:02.682009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:02.682888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:02.683178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:02.683457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] PATH_INFO: `/v3/users/09b47a2bfb26427f84cf6e76e14d622f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:02.684687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b47a2bfb26427f84cf6e76e14d622f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:02.686716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:02.738416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b47a2bfb26427f84cf6e76e14d622f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.739077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b47a2bfb26427f84cf6e76e14d622f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.739705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b47a2bfb26427f84cf6e76e14d622f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.747129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b47a2bfb26427f84cf6e76e14d622f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.759475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b47a2bfb26427f84cf6e76e14d622f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:02.773137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1217/2424] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:09:02 2022] DELETE /identity/v3/users/09b47a2bfb26427f84cf6e76e14d622f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:09:02.777728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:02.778019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:02.778298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:02.795537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:09:02.796688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:02.854975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1208/2425] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:09:02.864469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:02.865856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:02.924605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7a9f-ac31-46e5-97b1-9f7640461ddf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:02.928945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:02.929596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:02.930060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:02.930342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:02.939956 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:02.941399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954470da-4920-40e6-9ab6-ae3d0baaa9ec service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:02.951357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1218/2426] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:09:03.447157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:03.448673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:03.462826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12889-c2f3-4a91-9355-a1ccd5c20af3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:03.468109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:03.470368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:03.471084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:03.471438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] PATH_INFO: `/v3/projects/72d22677ecd548e08eb2b5bb1bbb31e0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:03.473757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d22677ecd548e08eb2b5bb1bbb31e0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:03.476872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:03.538771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d22677ecd548e08eb2b5bb1bbb31e0', 'request_id': 'req-d0046c27-4179-4737-8bc2-6b2b5c824054'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:03.546258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d22677ecd548e08eb2b5bb1bbb31e0', 'request_id': 'req-d0046c27-4179-4737-8bc2-6b2b5c824054'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:03.554153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d22677ecd548e08eb2b5bb1bbb31e0', 'request_id': 'req-d0046c27-4179-4737-8bc2-6b2b5c824054'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:03.584648 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] The token cache is being invalidate because project 72d22677ecd548e08eb2b5bb1bbb31e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:09:03.584905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:03.586275 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:09:03.591827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1209/2427] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:09:03 2022] DELETE /identity/v3/projects/72d22677ecd548e08eb2b5bb1bbb31e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:09:04.057249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2156-dc19-44d7-8d00-1f7aab8feefb None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:04.057754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2156-dc19-44d7-8d00-1f7aab8feefb None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:04.057848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2156-dc19-44d7-8d00-1f7aab8feefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:04.075988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d22b2156-dc19-44d7-8d00-1f7aab8feefb None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:09:04.077554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d22b2156-dc19-44d7-8d00-1f7aab8feefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:04.111028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:04.138641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1219/2428] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:09:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:09:04.151280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:04.152709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:04.184716 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:04.237739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0046c27-4179-4737-8bc2-6b2b5c824054 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:04.244683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:04.245959 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:04.246365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:04.247115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:04.257834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:04.259671 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:04.268345 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1210/2429] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:09:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:09:14.131774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=9 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:14.265160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=19 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:19.879334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:19.879842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:19.879952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:19.926098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:09:19.927291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:19.945292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1220/2430] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:09:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:09:19.958741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:19.981224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d38d3-a1aa-4edb-9cc3-385b5515b164 service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:19.988402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:19.989058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:19.989329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:19.989609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:19.999314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:20.000970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a9728-9b39-4695-90f3-c9952d9b2df0 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:20.010508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1211/2431] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:09:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:09:22.611990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:22.613397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:22.668173 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af7ee-2d71-4368-bd3f-ebeee01d87f9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:22.671741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:22.672385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:22.672668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:22.672945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:22.674714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:22.736890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:22.738487 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:22.748952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1221/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:09:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:09:30.006680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=10 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:32.744693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=68 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:34.327216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a742b-ba86-4355-a985-000e89ca9aef None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:34.327715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a742b-ba86-4355-a985-000e89ca9aef None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:34.327810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a742b-ba86-4355-a985-000e89ca9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:34.345293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c19a742b-ba86-4355-a985-000e89ca9aef None None] MFA Rules not processed for user `a0a8868b97c4487385b7cc46c9d769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:09:34.346485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c19a742b-ba86-4355-a985-000e89ca9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:34.400401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1212/2433] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:09:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:09:35.090000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:09:35.098489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247bb7f-29e8-480b-b7ac-bfeaac7fa640 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:09:35.101942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:09:35.102574 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:09:35.102850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:09:35.103122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:09:35.104928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:09:35.168615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:09:35.170062 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107c5c-8b0d-44ac-862f-5d0d5768e517 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:09:35.185438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1222/2434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:09:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:09:44.393263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=25 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:09:45.176237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=30 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:10:15.275807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:10:15.276295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:10:15.276413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:10:15.294420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] MFA Rules not processed for user `0690e45336654d62839d7bfdf779a577`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:10:15.295688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:10:15.357057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1213/2435] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:10:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:10:18.631770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:10:18.632291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:10:18.632398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:10:18.655821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] MFA Rules not processed for user `b470e4bbcf67422c860831db2f2d61af`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:10:18.657060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:10:18.718171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1223/2436] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:10:25.350358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=25 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:10:28.711384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=25 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:10:42.678590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:10:42.680052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:10:42.756237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7ab16-0afa-40e6-91d8-1a2b5fcda2bd None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:10:42.759819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:10:42.760391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:10:42.760674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:10:42.760948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:10:42.762685 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:10:42.843239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:10:42.844683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:10:42.865537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1214/2437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:10:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:10:43.022600 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:10:43.033803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5128d-f9e0-438e-b7b1-b43a3281f040 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:10:43.037580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:10:43.038248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:10:43.038510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:10:43.038785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:10:43.040700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:10:43.055227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:10:43.056716 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:10:43.068094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1224/2438] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:10:52.862692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=72 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:10:53.062944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:05.473048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:05.474389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:05.485518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09226f8-5424-43e9-97f6-22c6b5de3942 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:05.489587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:05.490218 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:05.490501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:05.490776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:05.492490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:05.507720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:05.509235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f483e-48d4-49ca-ac9a-d6307a34e1a3 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:05.517518 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1215/2439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:07.518810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:07.520319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:07.534148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32104895-463a-413a-8af6-2ec072b32475 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:07.540187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:07.540822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:07.541099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:07.541426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:07.543158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:07.554774 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:07.556397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:07.566609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1225/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:07.623134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:07.623631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:07.623740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:07.640134 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] MFA Rules not processed for user `a0a8868b97c4487385b7cc46c9d769f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:07.641473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:07.648943 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1216/2441] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:12.665326 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:12.677569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef12e-edb5-42b7-8425-3611ff59c6b2 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:12.683948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:12.684655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:12.685023 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:12.685522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:12.688469 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:12.701142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:12.703072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a53b7-3fa2-4be5-a70b-3b2374476c74 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:12.715371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1226/2442] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:13.349729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:13.352214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:13.385865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062927-b124-4d78-b156-8fc3a965bf02 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:13.395983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:13.397064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:13.397639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:13.398467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:13.401057 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:13.421559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:13.424321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:13.443168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1217/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:19.762649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620608-a340-4304-a85f-f7cd58b22ee8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:19.763176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620608-a340-4304-a85f-f7cd58b22ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:19.763290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d620608-a340-4304-a85f-f7cd58b22ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:19.782960 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-0d620608-a340-4304-a85f-f7cd58b22ee8 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:19.784208 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-0d620608-a340-4304-a85f-f7cd58b22ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:19.792112 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1227/2444] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:19.840256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:19.851459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0afd-cdfa-408f-b623-dde1da9fb7b8 service nova] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:19.857911 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:19.858541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:19.858824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:19.859100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:19.867624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:19.869184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:19.877082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1218/2445] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:11:23.804955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:23.805506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:23.805506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:23.833772 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:23.835125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:23.864058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1228/2446] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:23.878375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:23.895471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bdd1-c8f4-467f-a753-a42da73d2ad0 service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:23.901894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:23.902781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:23.903280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:23.903783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:23.921976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:23.923618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:23.964217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1219/2447] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:11:27.961799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:27.963286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:28.054095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12e22-5945-4176-9f8d-e7e606ae202e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:28.059104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:28.060211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:28.060663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:28.060943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] PATH_INFO: `/v3/users/ff89ac1543214afd8df4a39fe934eb39` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:28.064265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff89ac1543214afd8df4a39fe934eb39)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:28.067649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:28.129828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff89ac1543214afd8df4a39fe934eb39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.130640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff89ac1543214afd8df4a39fe934eb39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.131345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff89ac1543214afd8df4a39fe934eb39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.141043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff89ac1543214afd8df4a39fe934eb39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.156766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff89ac1543214afd8df4a39fe934eb39'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.173675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1229/2448] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:11:27 2022] DELETE /identity/v3/users/ff89ac1543214afd8df4a39fe934eb39 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:28.655117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:28.690107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51eeb8-bad3-4a70-9d87-db0e00648101 service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:28.787605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:28.790658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:28.791548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:28.792444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] PATH_INFO: `/v3/projects/dec23b88cdda4d7eb28bf33e9668aa7b` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:28.794441 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec23b88cdda4d7eb28bf33e9668aa7b)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:28.796512 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:28.858596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec23b88cdda4d7eb28bf33e9668aa7b', 'request_id': 'req-b26310d2-203d-40aa-93d6-c29c5f92104b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.865924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec23b88cdda4d7eb28bf33e9668aa7b', 'request_id': 'req-b26310d2-203d-40aa-93d6-c29c5f92104b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.872690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec23b88cdda4d7eb28bf33e9668aa7b', 'request_id': 'req-b26310d2-203d-40aa-93d6-c29c5f92104b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.892376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] The token cache is being invalidate because project dec23b88cdda4d7eb28bf33e9668aa7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:11:28.893623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.894587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:28.896631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1220/2449] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:11:28 2022] DELETE /identity/v3/projects/dec23b88cdda4d7eb28bf33e9668aa7b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:28.900445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:28.902397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:28.919268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad8177-7a3a-4ed5-822f-b3f798988040 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:28.980354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:29.012732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:29.014251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:29.014706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:29.015147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] PATH_INFO: `/v3/users/31933a72a39248b7b9970b913ff002e1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:29.016438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31933a72a39248b7b9970b913ff002e1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:29.018985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:29.079947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31933a72a39248b7b9970b913ff002e1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.081317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31933a72a39248b7b9970b913ff002e1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.082655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31933a72a39248b7b9970b913ff002e1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.095381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31933a72a39248b7b9970b913ff002e1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.111750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31933a72a39248b7b9970b913ff002e1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.126043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1230/2450] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:11:28 2022] DELETE /identity/v3/users/31933a72a39248b7b9970b913ff002e1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:29.353684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:29.355579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:29.374308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26310d2-203d-40aa-93d6-c29c5f92104b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:29.414373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:29.460012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:29.461344 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:29.461633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:29.461912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] PATH_INFO: `/v3/projects/e532bc5abdf6422f995087f1f3b88699` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:29.463112 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e532bc5abdf6422f995087f1f3b88699)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:29.465107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:29.530965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e532bc5abdf6422f995087f1f3b88699', 'request_id': 'req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.537544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e532bc5abdf6422f995087f1f3b88699', 'request_id': 'req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.546663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e532bc5abdf6422f995087f1f3b88699', 'request_id': 'req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.566634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] The token cache is being invalidate because project e532bc5abdf6422f995087f1f3b88699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:11:29.567068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.568033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:29.570109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1221/2451] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:11:29 2022] DELETE /identity/v3/projects/e532bc5abdf6422f995087f1f3b88699 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:37.875424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:37.877627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:37.972845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13010d10-c0ca-4820-99f8-19c63a381128 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:38.023795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:38.039584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:38.040235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:38.040515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:38.040789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:38.042589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:38.055572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:38.057176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337cbcf-326e-4884-9679-0673aafdddc4 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:38.069119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1231/2452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:38.298570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:38.301044 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:38.372163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebceea-258a-4bf0-982c-20a4dcfcc8e6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:38.377161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:38.377807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:38.378090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:38.378368 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:38.380163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:38.392902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:38.394564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:38.404982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1222/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:42.072706 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:42.073154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:42.073360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:42.091789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:42.092991 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:42.154839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1232/2454] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Jun 22 06:11:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:42.166632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:42.168259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:42.238373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:42.267251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fb1f-a63b-45ff-b304-e8efb626abae service placement] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:42.272290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:42.272951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:42.273231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:42.273503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:42.282041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:42.283703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:42.291681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1223/2455] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:11:47.391758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:47.393814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:47.454137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7ef3-ee97-46c8-a0c7-acdf15d1e385 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:47.458490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:47.459136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:47.459414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:47.459718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:47.461515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:47.526165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:47.527627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:47.538333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1233/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:51.432601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:51.434090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:51.448970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003661-fc9e-4d82-b009-7a0e52794d29 service swift] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:51.453842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:51.455262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:51.455596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:51.455879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] PATH_INFO: `/v3/users/0690e45336654d62839d7bfdf779a577` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:51.457081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0690e45336654d62839d7bfdf779a577)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:51.459087 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:51.507367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0690e45336654d62839d7bfdf779a577'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.521262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0690e45336654d62839d7bfdf779a577'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.521989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0690e45336654d62839d7bfdf779a577'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.522602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0690e45336654d62839d7bfdf779a577'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.530834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-716fddc3-a075-4c4f-8ef2-b6e678d2835d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0690e45336654d62839d7bfdf779a577'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.543235 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1224/2457] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:11:51 2022] DELETE /identity/v3/users/0690e45336654d62839d7bfdf779a577 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:51.794287 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:51.805433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a9f6-abfd-4ca7-a6b7-c5c8f6cd14a2 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:51.855697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=100 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:51.888517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:51.889406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:51.889685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:51.889985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] PATH_INFO: `/v3/projects/b5209c2872554c80b1fc770f46d4dda8` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:51.891160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5209c2872554c80b1fc770f46d4dda8)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:51.893158 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:51.944826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5209c2872554c80b1fc770f46d4dda8', 'request_id': 'req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.952280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5209c2872554c80b1fc770f46d4dda8', 'request_id': 'req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.958204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5209c2872554c80b1fc770f46d4dda8', 'request_id': 'req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.969356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] The token cache is being invalidate because project b5209c2872554c80b1fc770f46d4dda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:11:51.969684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.970335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-803c4e15-91b5-4ff4-81fc-f0b247b8eb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:11:51.971967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1234/2458] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:11:51 2022] DELETE /identity/v3/projects/b5209c2872554c80b1fc770f46d4dda8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:51.976960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:51.977504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:51.977722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:51.996792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:51.997999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:52.060041 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1225/2459] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:52.068181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51719af0-9015-4662-8abd-06c27543747e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.068472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51719af0-9015-4662-8abd-06c27543747e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.068775 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51719af0-9015-4662-8abd-06c27543747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.089834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-51719af0-9015-4662-8abd-06c27543747e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:52.091053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-51719af0-9015-4662-8abd-06c27543747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:52.099269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1235/2460] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:52.103448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.114707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9488584-5deb-41fc-9db8-a3541f15f99b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.119309 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.120001 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.120291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.120568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.121283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:11:52.121587 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.123168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.138497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1226/2461] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:11:52.139483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51719af0-9015-4662-8abd-06c27543747e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.148654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51719af0-9015-4662-8abd-06c27543747e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.153309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.154032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.154957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.155233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.155963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.157853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.184161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1236/2462] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:11:52 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:11:52.189906 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.200260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157119b9-245d-45a7-8c21-7d905a7f1608 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.231520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:52.268564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.269224 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.269503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.269772 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.270450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.272394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.296566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1227/2463] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:11:52 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:11:52.297739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.308596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01ed0a-a33b-4f3b-95e6-850fb09ecde6 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.313160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.313840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.314120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.314395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.315108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.316729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.327077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1237/2464] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:11:52.331274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.341191 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf3bc6-8a2c-47e4-a554-9bc8f3675192 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.346681 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.346953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.347240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.347777 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.348520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.350228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0374d-acef-4df3-9848-03180048c200 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.362813 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1228/2465] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:11:52.366918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.378224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b62f-5483-4852-ac0f-9bf14b180ac1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.382787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.383692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.383975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.384252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] PATH_INFO: `/v3/projects/5d45246ffd7c46838d124feb1663c52d/users/2fef8e733a7d41d59fe3e86936e1a2fe/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.399395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d45246ffd7c46838d124feb1663c52d, user_id=2fef8e733a7d41d59fe3e86936e1a2fe, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.402967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.417876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1238/2466] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:11:52 2022] PUT /identity/v3/projects/5d45246ffd7c46838d124feb1663c52d/users/2fef8e733a7d41d59fe3e86936e1a2fe/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:11:52.422853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5f64-ae67-4db6-81f5-6e67918e9873 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.423138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5f64-ae67-4db6-81f5-6e67918e9873 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.423415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5f64-ae67-4db6-81f5-6e67918e9873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.441088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e66c5f64-ae67-4db6-81f5-6e67918e9873 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:52.442463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e66c5f64-ae67-4db6-81f5-6e67918e9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:52.499296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1229/2467] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:52.509876 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:52.511663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:52.568759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27763ed2-3b44-4f4e-94e8-57c773e1a120 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:52.572372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:52.573014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:52.573295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:52.573603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:52.583955 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:52.585397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:52.599237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1239/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:57.789842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9ba5-4649-415b-8be7-f96101959e91 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:57.790367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9ba5-4649-415b-8be7-f96101959e91 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:57.790488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe9ba5-4649-415b-8be7-f96101959e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:57.819434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-08fe9ba5-4649-415b-8be7-f96101959e91 None None] MFA Rules not processed for user `2fef8e733a7d41d59fe3e86936e1a2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:57.820699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-08fe9ba5-4649-415b-8be7-f96101959e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:57.890598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1230/2469] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:11:57.904491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:11:57.905984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:57.916622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:11:58.015495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df530-d80b-47ea-bca9-0a8708cd387c service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:11:58.021186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:11:58.021924 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:58.022282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:58.023260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:58.034391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:11:58.035853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:11:58.049399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1240/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:11:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:11:59.734500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d330-06bc-42ab-a795-fad9c5a84a69 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:11:59.735015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d330-06bc-42ab-a795-fad9c5a84a69 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:11:59.735662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d330-06bc-42ab-a795-fad9c5a84a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:11:59.754077 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2258d330-06bc-42ab-a795-fad9c5a84a69 None None] MFA Rules not processed for user `2fef8e733a7d41d59fe3e86936e1a2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:11:59.755289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2258d330-06bc-42ab-a795-fad9c5a84a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:11:59.762740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1231/2471] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:11:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:00.135947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:00.149286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2b70-4620-4f9a-9d95-334703dda6dc service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:00.153056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:00.153760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:00.154047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:00.154458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:00.159609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:00.171030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:00.172547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:00.181961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1241/2472] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:12:00.998788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:00.999690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:01.000177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:01.030753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] MFA Rules not processed for user `1fdb302d62da4b2b8e6c238e11d08f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:01.033313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:01.089708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:01.168921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1232/2473] 10.222.0.13 () {58 vars in 967 bytes} [Wed Jun 22 06:12:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:01.173384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:01.175762 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:01.336247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:01.337815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:01.348249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d362b8-3ee8-4f9e-90ce-1ed4046fdc2f service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:01.355652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1701e-d8ed-4723-a109-a88ee6ce5c13 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:01.357807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8b3103a87541c7ae82ca280985f174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:01.358475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:01.358747 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:01.360670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:01.365486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:01.368306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:01.368795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:01.369238 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:01.374467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:01.375394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:01.378558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:01.391087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1242/2474] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Jun 22 06:12:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 06:12:01.396738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:01.398553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:01.419822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1233/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:12:11.385800 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=69 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:11.405713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=17 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:12.117979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:12.119412 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:12.134906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a491f1-a760-4a60-8d55-8d3c88370f7c service swift] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:12.140602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:12.141284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:12.141571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:12.141847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:12.143587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:12.206289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:12.207951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:12.219698 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1243/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:16.868422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:16.877534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f363af-dfa6-46c4-bd8b-4b5353a15933 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:16.881184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:16.881809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:16.882088 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:16.882360 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:16.884140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:16.897469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:16.899117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:16.909876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1234/2477] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:17.818673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:17.830433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b3d4-e8a7-43bd-a48a-9ab5fe28c2df service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:17.836296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:17.837125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:17.837477 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:17.837848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:17.839908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:17.853066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:17.854785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:17.866669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1244/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:20.406566 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:20.408241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:20.465075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:20.466791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:20.487786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def9b22-042e-40c3-9b3d-ee6c6c5a12f0 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:20.494467 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:20.495394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:20.495656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:20.495934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] PATH_INFO: `/v3/users/a0a8868b97c4487385b7cc46c9d769f2` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:20.497128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a8868b97c4487385b7cc46c9d769f2)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:20.499092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:20.516700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f04e-7195-4334-aaa0-31e0dc096998 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:20.525937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:20.526961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:20.527427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:20.527821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:20.530152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:20.559640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:20.561524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:20.569492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a8868b97c4487385b7cc46c9d769f2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.570247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a8868b97c4487385b7cc46c9d769f2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.571912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a8868b97c4487385b7cc46c9d769f2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.583684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a8868b97c4487385b7cc46c9d769f2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.587837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1235/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:20.601231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-77282208-92e1-47e2-bf67-2fa773e1674b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a8868b97c4487385b7cc46c9d769f2'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.615083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1245/2480] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:20 2022] DELETE /identity/v3/users/a0a8868b97c4487385b7cc46c9d769f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:20.787135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:20.798554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f492cb-9163-48ca-8bc8-32d69cb1b16e service placement] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:20.854247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:20.855093 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:20.855379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:20.855693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] PATH_INFO: `/v3/projects/c30bf61e758f4599b37014f6fd9f2307` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:20.856890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30bf61e758f4599b37014f6fd9f2307)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:20.858946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:20.902921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30bf61e758f4599b37014f6fd9f2307', 'request_id': 'req-f3583897-1400-4a1c-833b-01722022c956'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.909399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30bf61e758f4599b37014f6fd9f2307', 'request_id': 'req-f3583897-1400-4a1c-833b-01722022c956'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.914921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30bf61e758f4599b37014f6fd9f2307', 'request_id': 'req-f3583897-1400-4a1c-833b-01722022c956'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.927642 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] The token cache is being invalidate because project c30bf61e758f4599b37014f6fd9f2307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:20.927932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.928550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f3583897-1400-4a1c-833b-01722022c956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:20.930078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1236/2481] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:20 2022] DELETE /identity/v3/projects/c30bf61e758f4599b37014f6fd9f2307 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:20.935136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:20.935431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:20.935739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:20.953116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:20.954493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:21.011830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:21.021905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1246/2482] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:21.029590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.029817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.030101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.043174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:21.050288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:21.051929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:21.061698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1237/2483] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:21.066057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.076915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9601-a38a-4634-a860-f5875af5765f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.081621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.082272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.082557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.082947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.083717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:21.084100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.085674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.098269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1247/2484] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:21.102738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.112970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544c72-5320-4ecd-927a-a2e5c80a05d1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.117682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.118334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.118621 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.118897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.119616 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.121562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.160166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1238/2485] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:21.161729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.172368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e22660-a979-4cbd-b538-6d541a0cda01 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.237589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.238310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.238598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.238871 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.239597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.241607 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.262697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1248/2486] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:21.267658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.277923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31448-68b6-4951-a01a-b70b4e58c759 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.283205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.283818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.284099 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.284373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.285089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.286668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.296790 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1239/2487] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:21.304517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.316094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a94f-daef-4c8e-84cb-f0549bbf6153 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.320719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.321369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.321655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.321933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.322679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.324389 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dd981-252c-40ba-9bbf-c91e857886bc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.334996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1249/2488] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:21.338971 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.349481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4695c-db5a-4a3d-9103-e4064ff76bf8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.354009 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.354867 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.355175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.355450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] PATH_INFO: `/v3/projects/9282f957a58844d9b955fb07c32d0407/users/1b74d0a6a54842789c55b4b775331693/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.370678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9282f957a58844d9b955fb07c32d0407, user_id=1b74d0a6a54842789c55b4b775331693, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.373326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.386067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1240/2489] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:21 2022] PUT /identity/v3/projects/9282f957a58844d9b955fb07c32d0407/users/1b74d0a6a54842789c55b4b775331693/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:21.397185 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.397476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.397755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.423603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] MFA Rules not processed for user `1b74d0a6a54842789c55b4b775331693`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:21.424779 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:21.486255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1250/2490] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:21.490601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.560527 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229920d-0811-40fb-9647-f6741589d98a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.565585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.566228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.566509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.566783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.567472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.569387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.597179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1241/2491] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:21.602249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.613209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024967f-aae7-4eec-bd1c-3a424e17c3a8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.661897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:21.671984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.672655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.673058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.673343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.674042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.675997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.695735 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1251/2492] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:21.699713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.710757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364fb3-6d4b-4d60-a282-9e602b5690cb admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.715393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.716078 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.716364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.716645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.717366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.718963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.729317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1242/2493] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:21.733226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.742934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277f7ec-c143-4c1e-85ae-e16a9f29043d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.747586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.748453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.748737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.749017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] PATH_INFO: `/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d/users/6d18b078278c4ce08da0b3d8babeb8a4/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.764252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f30138cede4eacbc6b7b3aa8245e6d, user_id=6d18b078278c4ce08da0b3d8babeb8a4, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.767541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.781097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1252/2494] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:21 2022] PUT /identity/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d/users/6d18b078278c4ce08da0b3d8babeb8a4/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:21.785080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.794896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522336-01b4-400d-867e-70be988401f3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.850158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.850738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.851021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.851301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.852058 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.853645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b9cee-f2b7-43b0-a6bf-c15ffafe9692 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.863659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1243/2495] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:21.867868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:21.878699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70f0fc-920a-4ced-87bc-d34d82d3a92a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:21.883266 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:21.884232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.884502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.884777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] PATH_INFO: `/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d/users/6d18b078278c4ce08da0b3d8babeb8a4/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.886728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f30138cede4eacbc6b7b3aa8245e6d, user_id=6d18b078278c4ce08da0b3d8babeb8a4, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:21.889400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:21.899372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1253/2496] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:21 2022] PUT /identity/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d/users/6d18b078278c4ce08da0b3d8babeb8a4/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:21.909411 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:21.909699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:21.909979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:21.916582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:21.936833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] MFA Rules not processed for user `6d18b078278c4ce08da0b3d8babeb8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:21.938676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:22.005817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1244/2497] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:22.016449 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:22.018176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:22.073612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849a065-6cfe-4f7f-ad84-10bd0216ad65 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:22.077506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:22.078134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:22.078418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:22.078697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:22.087528 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:22.088948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:22.098147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1254/2498] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:22.167855 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:22.178241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b776ddc-b6f6-4742-be78-78952a40e5df None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:22.181814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:22.182450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:22.182731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:22.183007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:22.239888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:22.241323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b1fba-c8fa-4973-9d39-38024c258308 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:22.250737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1245/2499] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:26.250419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:26.310552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17bf-e37c-4777-94f8-0968bcf9d511 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:26.315573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:26.316482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:26.316763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:26.317034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] PATH_INFO: `/v3/users/1b74d0a6a54842789c55b4b775331693` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:26.318198 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b74d0a6a54842789c55b4b775331693)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:26.320146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:26.365375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b74d0a6a54842789c55b4b775331693'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.366008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b74d0a6a54842789c55b4b775331693'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.366612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b74d0a6a54842789c55b4b775331693'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.369042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:26.375351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b74d0a6a54842789c55b4b775331693'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.388767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b74d0a6a54842789c55b4b775331693'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.400824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1255/2500] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:26 2022] DELETE /identity/v3/users/1b74d0a6a54842789c55b4b775331693 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:26.405232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:26.405692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:26.405796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:26.422750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:26.423974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:26.493061 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1246/2501] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:26.503166 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:26.504573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:26.559670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435e353-3415-4a29-881b-d090ff1c4916 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:26.563910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:26.564544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:26.564826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:26.565096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:26.573946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:26.575657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:26.584917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1256/2502] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:26.850954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:26.852456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:26.864996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6351e5-58ae-49bd-b662-8ff2ca849a5e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:26.869907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:26.870903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:26.871266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:26.871447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] PATH_INFO: `/v3/projects/9282f957a58844d9b955fb07c32d0407` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:26.872751 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9282f957a58844d9b955fb07c32d0407)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:26.874651 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:26.899635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:26.923447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9282f957a58844d9b955fb07c32d0407', 'request_id': 'req-c284dff4-c5f5-4139-ba9a-793299d57e33'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.929555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9282f957a58844d9b955fb07c32d0407', 'request_id': 'req-c284dff4-c5f5-4139-ba9a-793299d57e33'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.934871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9282f957a58844d9b955fb07c32d0407', 'request_id': 'req-c284dff4-c5f5-4139-ba9a-793299d57e33'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.947682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] The token cache is being invalidate because project 9282f957a58844d9b955fb07c32d0407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:26.947967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.948591 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:26.950119 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1247/2503] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:26 2022] DELETE /identity/v3/projects/9282f957a58844d9b955fb07c32d0407 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:26.956281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:26.965799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798231a-568c-426f-8657-0e9df2de6eb8 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.021373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.022238 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.022646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.022923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] PATH_INFO: `/v3/users/6d18b078278c4ce08da0b3d8babeb8a4` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.024143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d18b078278c4ce08da0b3d8babeb8a4)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.026078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.072803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d18b078278c4ce08da0b3d8babeb8a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.073456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d18b078278c4ce08da0b3d8babeb8a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.074051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d18b078278c4ce08da0b3d8babeb8a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.080837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d18b078278c4ce08da0b3d8babeb8a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.092218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-592e92ba-a66a-4bc8-b2fb-8b928dc4998d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d18b078278c4ce08da0b3d8babeb8a4'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.093889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:27.106908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1257/2504] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:26 2022] DELETE /identity/v3/users/6d18b078278c4ce08da0b3d8babeb8a4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:27.374285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.376381 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:27.390669 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dff4-c5f5-4139-ba9a-793299d57e33 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.448683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.449540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.449824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.450159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] PATH_INFO: `/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.451577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f30138cede4eacbc6b7b3aa8245e6d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.453533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.501388 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f30138cede4eacbc6b7b3aa8245e6d', 'request_id': 'req-610858ad-ca94-4936-b052-44b518784c4e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.507594 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f30138cede4eacbc6b7b3aa8245e6d', 'request_id': 'req-610858ad-ca94-4936-b052-44b518784c4e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.513125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f30138cede4eacbc6b7b3aa8245e6d', 'request_id': 'req-610858ad-ca94-4936-b052-44b518784c4e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.525721 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] The token cache is being invalidate because project 47f30138cede4eacbc6b7b3aa8245e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:27.526010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.526625 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-610858ad-ca94-4936-b052-44b518784c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:27.528198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1248/2505] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:27 2022] DELETE /identity/v3/projects/47f30138cede4eacbc6b7b3aa8245e6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:27.533751 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.534237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.534341 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.556908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:27.558804 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:27.628966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1258/2506] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:27.637190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.637478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.637778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.655760 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:27.657483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:27.665263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1249/2507] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:27.669711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.679999 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187337-63ea-439e-9d82-52f95cead0c4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.684604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.685248 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.685530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.685805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.686524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:27.686832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.688509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.699930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1259/2508] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:27.704501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.713544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36fa5-2611-48e8-8074-8cc787aab513 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.718128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.719293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.719618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.719891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.720576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.722499 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.747139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1250/2509] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:27 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:27.751336 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.761397 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cdeab-4a37-49ed-aded-0f04d9e07926 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.816728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.817378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.817658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.817935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.818630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.820564 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.840417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1260/2510] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:27 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:27.844434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.854779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57535-479b-480e-8195-f2b0c062941e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.859994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.860638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.860919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.861190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.861902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.863468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.875089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1251/2511] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:27.879357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.889251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7302ee3-ce73-404b-91da-2d37c55bef84 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.894300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.894935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.895214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.895485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.896224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.897803 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c5704-9713-4810-8e74-9e1df9c1d630 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.908148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1261/2512] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:27.912132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:27.917415 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:27.923972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c4c80-f4d3-430a-9e05-a58b6490073d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:27.929301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:27.930192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.930479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.930753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] PATH_INFO: `/v3/projects/2e30d4eb7d58466cb112962ad80bf787/users/9facea75f59b4024a967191c80ec8717/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:27.945095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e30d4eb7d58466cb112962ad80bf787, user_id=9facea75f59b4024a967191c80ec8717, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:27.947960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:27.961408 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1252/2513] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:27 2022] PUT /identity/v3/projects/2e30d4eb7d58466cb112962ad80bf787/users/9facea75f59b4024a967191c80ec8717/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:27.977256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:27.977571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:27.977903 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.004087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] MFA Rules not processed for user `9facea75f59b4024a967191c80ec8717`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:28.005276 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:28.048268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:28.069120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1262/2514] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:28.073603 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.133973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393f86-1101-445e-974a-d8923c363516 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.138629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.139265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.139570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.139845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.141063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.142939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.167369 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1253/2515] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:28 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:28.171705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.182365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01845a-fc7b-4181-84a8-60e47deb6bc2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.240365 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.241028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.241309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.241582 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.242301 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.244284 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.264688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1263/2516] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:28 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:28.269314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.280028 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d48af-c4f9-4a5e-86a8-651356973209 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.284606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.285251 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.285532 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.285807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.286522 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.288148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.298526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1254/2517] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:28.302753 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.313225 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc15d-06e1-40e8-bf42-c4182bfbadd4 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.317813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.318671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.318958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.319224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] PATH_INFO: `/v3/projects/06a626cee61f497cb12ecf5d7443c8b5/users/10fa75a294fb4fb1ae51ddec3925b9bc/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.334217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a626cee61f497cb12ecf5d7443c8b5, user_id=10fa75a294fb4fb1ae51ddec3925b9bc, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.336916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.349634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1264/2518] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:28 2022] PUT /identity/v3/projects/06a626cee61f497cb12ecf5d7443c8b5/users/10fa75a294fb4fb1ae51ddec3925b9bc/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:28.353457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.363208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0a898-5081-4d01-8cb8-5aac3fd93227 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.419131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.419816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.420127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.420402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.421121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.422761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c565-1b37-4cb7-b322-d8fb86f0580d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.432630 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1255/2519] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:28.436742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.447553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7212f-5832-4e75-928c-5858925442cc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.452390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.453861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.454145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.454420 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] PATH_INFO: `/v3/projects/06a626cee61f497cb12ecf5d7443c8b5/users/10fa75a294fb4fb1ae51ddec3925b9bc/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.456411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a626cee61f497cb12ecf5d7443c8b5, user_id=10fa75a294fb4fb1ae51ddec3925b9bc, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.459056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.469075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1265/2520] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:28 2022] PUT /identity/v3/projects/06a626cee61f497cb12ecf5d7443c8b5/users/10fa75a294fb4fb1ae51ddec3925b9bc/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:28.479270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.479811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.479811 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.506110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] MFA Rules not processed for user `10fa75a294fb4fb1ae51ddec3925b9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:28.507324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:28.545503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:28.577068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1256/2521] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:28.588186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:28.589883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:28.646199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0973a6f-f13b-4311-b34d-f7ac0daa9d79 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:28.649724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:28.650355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:28.650635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:28.650906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:28.659593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:28.661009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e19b6-9e72-4935-bae1-611238ab06f7 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:28.670162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1266/2522] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:29.246146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:29.306836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0611-05ae-4b7f-8b0d-f4b8e91e8e47 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:29.311223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:29.312631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:29.312912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:29.313184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] PATH_INFO: `/v3/users/9facea75f59b4024a967191c80ec8717` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:29.314352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9facea75f59b4024a967191c80ec8717)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:29.316296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:29.365878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9facea75f59b4024a967191c80ec8717'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.382723 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9facea75f59b4024a967191c80ec8717'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.383452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9facea75f59b4024a967191c80ec8717'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.384089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9facea75f59b4024a967191c80ec8717'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.391969 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9facea75f59b4024a967191c80ec8717'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.405048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1257/2523] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:29 2022] DELETE /identity/v3/users/9facea75f59b4024a967191c80ec8717 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:29.409701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:29.409997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:29.410282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:29.428144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:29.429344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:29.463253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:29.489814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1267/2524] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:29.499280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:29.501262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:29.556302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e071-0a1e-4eb8-9db2-f67d17941428 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:29.560011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:29.560590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:29.560874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:29.561150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:29.568580 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:29.571022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:29.572976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:29.584553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1258/2525] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:29.857330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:29.858788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:29.871682 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ae6f-c60a-4cdb-b79e-70c42d7a89b2 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:29.876619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:29.877482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:29.877765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:29.878042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] PATH_INFO: `/v3/projects/2e30d4eb7d58466cb112962ad80bf787` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:29.879351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e30d4eb7d58466cb112962ad80bf787)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:29.881408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:29.928211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e30d4eb7d58466cb112962ad80bf787', 'request_id': 'req-b971ee47-698e-4f72-b338-c6664151283f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.936193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e30d4eb7d58466cb112962ad80bf787', 'request_id': 'req-b971ee47-698e-4f72-b338-c6664151283f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.943462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e30d4eb7d58466cb112962ad80bf787', 'request_id': 'req-b971ee47-698e-4f72-b338-c6664151283f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.957906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] The token cache is being invalidate because project 2e30d4eb7d58466cb112962ad80bf787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:29.958189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.958816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:29.960377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1268/2526] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:29 2022] DELETE /identity/v3/projects/2e30d4eb7d58466cb112962ad80bf787 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:29.964378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:29.974386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922898c-9c4d-4f02-89b4-a243431b9904 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.036543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.037406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.037687 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.037961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] PATH_INFO: `/v3/users/10fa75a294fb4fb1ae51ddec3925b9bc` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.039121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fa75a294fb4fb1ae51ddec3925b9bc)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.041095 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.086672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fa75a294fb4fb1ae51ddec3925b9bc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.098787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fa75a294fb4fb1ae51ddec3925b9bc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.099459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fa75a294fb4fb1ae51ddec3925b9bc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.100136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fa75a294fb4fb1ae51ddec3925b9bc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.107592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4fc8b0f7-31b2-449b-8450-fc9df1653963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fa75a294fb4fb1ae51ddec3925b9bc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.123086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1259/2527] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:29 2022] DELETE /identity/v3/users/10fa75a294fb4fb1ae51ddec3925b9bc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:30.400531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.401984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:30.419807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971ee47-698e-4f72-b338-c6664151283f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.478807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.479829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.480115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.480395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] PATH_INFO: `/v3/projects/06a626cee61f497cb12ecf5d7443c8b5` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.481583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a626cee61f497cb12ecf5d7443c8b5)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.483521 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.528699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a626cee61f497cb12ecf5d7443c8b5', 'request_id': 'req-af36a8a7-571c-4f18-b1be-d8020797d1fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.536842 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a626cee61f497cb12ecf5d7443c8b5', 'request_id': 'req-af36a8a7-571c-4f18-b1be-d8020797d1fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.542289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a626cee61f497cb12ecf5d7443c8b5', 'request_id': 'req-af36a8a7-571c-4f18-b1be-d8020797d1fb'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.543372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:30.555641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] The token cache is being invalidate because project 06a626cee61f497cb12ecf5d7443c8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:30.555931 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.556567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af36a8a7-571c-4f18-b1be-d8020797d1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:30.558350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1269/2528] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:30 2022] DELETE /identity/v3/projects/06a626cee61f497cb12ecf5d7443c8b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:30.563707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.564175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.564295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.584362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:30.585545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:30.645429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1260/2529] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:30.653317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.653604 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.653888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.671858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:30.673034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:30.680829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1270/2530] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:30.685027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.695319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaecc8-1f06-4570-b8ea-7b507058dc03 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.699833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.700744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.701022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.701293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.702033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:30.702362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.704495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.715678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1261/2531] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:12:30.719998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.729252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dbf74-0fb4-4633-9bf8-51b068e0e194 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.734259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.734904 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.735187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.735461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.736182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.738119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.765717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1271/2532] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:30 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:30.769819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.775176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:30.781141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418121f1-0f8a-46c7-b6ec-97d50de78f53 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.844854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.845599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.846085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.846537 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.847244 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.850504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.871329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1262/2533] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:30 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:30.876337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.886718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d1765-5b60-4dd7-ab0a-0bf4b8922f37 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.891344 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.892026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.892314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.892624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.893345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.894953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.906460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1272/2534] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:30.909727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.919825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581afa-8294-417f-9f44-1456252cbdc2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.924934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.925578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.925859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.926132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.926874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.928473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6b5a0-21c1-4f2b-97c7-506e7f9e4869 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.939089 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1263/2535] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:30.943181 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:30.953405 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd8d2d-4f02-42ba-bac8-680b72530b14 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:30.957932 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:30.958807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:30.959086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:30.959357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] PATH_INFO: `/v3/projects/81a1bc07a17f4dce91b0d4f2863e67ae/users/3f551f50fd074d209c21eeca06c50ecd/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:30.974591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a1bc07a17f4dce91b0d4f2863e67ae, user_id=3f551f50fd074d209c21eeca06c50ecd, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:30.977324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:30.990844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1273/2536] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:30 2022] PUT /identity/v3/projects/81a1bc07a17f4dce91b0d4f2863e67ae/users/3f551f50fd074d209c21eeca06c50ecd/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:31.003435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.003994 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.004454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.032199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] MFA Rules not processed for user `3f551f50fd074d209c21eeca06c50ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:31.035535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:31.111750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1264/2537] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:31.116409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.177603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3a60-1a64-4e12-a81d-3a52c4183663 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.182172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.182822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.183108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.183384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.184111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.186029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.212349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1274/2538] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:31 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:31.216419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.227820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea794cd-ef80-43aa-a192-3bf1178f1ce3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.283026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.283717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.284007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.284284 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.284978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.286882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.301705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:31.307223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1265/2539] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:31 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:31.311125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.321403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b254dd-69ba-416f-a10a-6c0e72da0da9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.326297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.326946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.327232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.327568 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.328294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.329892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.340212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1275/2540] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:31.344736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.356325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377c10-b81b-4659-adf9-5a8f0e0da2bc admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.362324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.363198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.363486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.363805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] PATH_INFO: `/v3/projects/b113979ee5784f29a859a3db3924c59f/users/08c440eaa1f24749b7a3557bdad46a46/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.378551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b113979ee5784f29a859a3db3924c59f, user_id=08c440eaa1f24749b7a3557bdad46a46, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.381262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.393675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1266/2541] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:31 2022] PUT /identity/v3/projects/b113979ee5784f29a859a3db3924c59f/users/08c440eaa1f24749b7a3557bdad46a46/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:31.397613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.408255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecad7a6-5cc0-4db7-bc76-28a6300a0327 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.462602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.463190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.463474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.463782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.464504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.466098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2ceb5-9e03-4b22-b6e3-694ab53b61ab admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.471561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:31.477148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1276/2542] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:31.481237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.492066 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd3c05-4305-420b-8467-ff154c2b287e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.496551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.497412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.497693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.497966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] PATH_INFO: `/v3/projects/b113979ee5784f29a859a3db3924c59f/users/08c440eaa1f24749b7a3557bdad46a46/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.499923 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b113979ee5784f29a859a3db3924c59f, user_id=08c440eaa1f24749b7a3557bdad46a46, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.502545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.512545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1267/2543] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:31 2022] PUT /identity/v3/projects/b113979ee5784f29a859a3db3924c59f/users/08c440eaa1f24749b7a3557bdad46a46/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:31.522770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.523058 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.523335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.549983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] MFA Rules not processed for user `08c440eaa1f24749b7a3557bdad46a46`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:31.551168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:31.622567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1277/2544] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:31.633503 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:31.635272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:31.691160 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f2cb-dc69-4019-a586-d8a12a714a0b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:31.694821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:31.695457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:31.695771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:31.696048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:31.750543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:31.751955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62fca9-faa2-4805-819e-c7b93588706f service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:31.760798 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1268/2545] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:34.277801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:34.339243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06181-8c02-4fdc-adea-2d1db0364573 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:34.343684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:34.344536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:34.344816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:34.345091 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] PATH_INFO: `/v3/users/3f551f50fd074d209c21eeca06c50ecd` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:34.346257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f551f50fd074d209c21eeca06c50ecd)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:34.348318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:34.392746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f551f50fd074d209c21eeca06c50ecd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.393386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f551f50fd074d209c21eeca06c50ecd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.393990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f551f50fd074d209c21eeca06c50ecd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.401134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f551f50fd074d209c21eeca06c50ecd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.412962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f551f50fd074d209c21eeca06c50ecd'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.424732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1278/2546] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:34 2022] DELETE /identity/v3/users/3f551f50fd074d209c21eeca06c50ecd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:34.429239 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:34.429707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:34.429806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:34.446643 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:34.447862 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:34.505768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1269/2547] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:34.516436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:34.517667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:34.524122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:34.574205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820abd64-53f2-4b83-8e6e-f09057aee537 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:34.578746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:34.579377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:34.579694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:34.579971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:34.588840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:34.590272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:34.599649 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1279/2548] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:34.860864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:34.862291 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:34.874859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb430-472d-44df-90c0-ae27b48257e1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:34.879958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:34.880817 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:34.881100 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:34.881405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] PATH_INFO: `/v3/projects/81a1bc07a17f4dce91b0d4f2863e67ae` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:34.882756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a1bc07a17f4dce91b0d4f2863e67ae)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:34.884692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:34.897289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:34.931406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a1bc07a17f4dce91b0d4f2863e67ae', 'request_id': 'req-4328283c-ecce-4fbc-be00-da3fe970b160'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.938150 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a1bc07a17f4dce91b0d4f2863e67ae', 'request_id': 'req-4328283c-ecce-4fbc-be00-da3fe970b160'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.943807 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a1bc07a17f4dce91b0d4f2863e67ae', 'request_id': 'req-4328283c-ecce-4fbc-be00-da3fe970b160'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.955946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] The token cache is being invalidate because project 81a1bc07a17f4dce91b0d4f2863e67ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:34.956231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.956866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:34.958383 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1270/2549] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:34 2022] DELETE /identity/v3/projects/81a1bc07a17f4dce91b0d4f2863e67ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:34.962360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:34.972475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114bbb-2c76-49e2-b67d-555016a65d2f service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.027000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.027899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.028182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.028456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] PATH_INFO: `/v3/users/08c440eaa1f24749b7a3557bdad46a46` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.029629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c440eaa1f24749b7a3557bdad46a46)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.032134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.077067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c440eaa1f24749b7a3557bdad46a46'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.077685 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c440eaa1f24749b7a3557bdad46a46'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.078302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c440eaa1f24749b7a3557bdad46a46'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.085416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c440eaa1f24749b7a3557bdad46a46'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.097531 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-44d954be-0d50-45bf-b3d5-13baa55619bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c440eaa1f24749b7a3557bdad46a46'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.109865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1280/2550] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:34 2022] DELETE /identity/v3/users/08c440eaa1f24749b7a3557bdad46a46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:35.380453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.381958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:35.401504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328283c-ecce-4fbc-be00-da3fe970b160 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.457977 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.458826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.459109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.459384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] PATH_INFO: `/v3/projects/b113979ee5784f29a859a3db3924c59f` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.460593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b113979ee5784f29a859a3db3924c59f)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.462500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.507999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b113979ee5784f29a859a3db3924c59f', 'request_id': 'req-442aa7f5-102b-46fa-800d-a1d448067d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.513982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b113979ee5784f29a859a3db3924c59f', 'request_id': 'req-442aa7f5-102b-46fa-800d-a1d448067d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.519961 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b113979ee5784f29a859a3db3924c59f', 'request_id': 'req-442aa7f5-102b-46fa-800d-a1d448067d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.532189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] The token cache is being invalidate because project b113979ee5784f29a859a3db3924c59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:35.532501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.533124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-442aa7f5-102b-46fa-800d-a1d448067d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:35.534639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1271/2551] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:35 2022] DELETE /identity/v3/projects/b113979ee5784f29a859a3db3924c59f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:35.539650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.540143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.540272 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.557245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:35.558417 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:35.579109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:35.618959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1281/2552] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:35.628410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.628744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.629025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.647990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:35.649199 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:35.657825 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1272/2553] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:35.662455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.672332 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789785f-c8ac-4f0e-bba2-f482ca8b0e1d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.676914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.677558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.677841 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.678116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.678834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:35.679139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.680755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.692215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1282/2554] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:35.696384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.706268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b05a-9255-4ece-8145-f2e2f51cc437 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.710932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.711596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.711879 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.712156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.712833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.714715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.741249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1273/2555] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:35 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:35.744184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.754504 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5aa7aa-036a-495f-be83-705c6c056d26 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.808739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.809391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.809676 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.809951 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.810629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.813095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.832080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1283/2556] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:35 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:35.836114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.841454 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:35.847728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970947-7a03-4dc9-874e-4d6fa4139b0c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.853116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.853783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.854062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.854336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.855051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.856701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.866830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1274/2557] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:35.870593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.881147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead413a-7010-4068-b6c8-468b08197011 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.885710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.886431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.886790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.887083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.887855 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.889447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9deaa-fef3-4813-8b58-0d260d3fa63a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.899780 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1284/2558] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:35.903690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:35.913435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04b63e-33e4-4c55-848e-527517cacb86 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:35.918049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:35.918902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.919181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.919457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] PATH_INFO: `/v3/projects/e4fac1c7341e476e830c8d887dff4893/users/dda9dc24e29444a9b4cc1980253ea83c/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.933361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fac1c7341e476e830c8d887dff4893, user_id=dda9dc24e29444a9b4cc1980253ea83c, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:35.935993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:35.948676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1275/2559] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:35 2022] PUT /identity/v3/projects/e4fac1c7341e476e830c8d887dff4893/users/dda9dc24e29444a9b4cc1980253ea83c/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:35.960584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:35.960879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:35.961184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:35.987372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] MFA Rules not processed for user `dda9dc24e29444a9b4cc1980253ea83c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:35.988686 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:36.053509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1285/2560] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:36.058010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.120510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f147a2-9e24-4a96-aa6a-8e3e9b5b250d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.125650 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.126294 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.126574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.126847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.127557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.129473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.153656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1276/2561] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:36.157690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.168271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da235056-a45f-4a69-a632-b7df2899fc80 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.186433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:36.230034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.230695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.230978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.231259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.231986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.234593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.254552 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1286/2562] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:36.258505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.268954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561df47-55aa-43c2-856c-52a6413a85d3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.273628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.274276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.274563 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.274843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.275607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.277193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.287626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1277/2563] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:36.291655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.301905 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbda872-4e99-40f2-a81b-2346093343ab admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.306446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.307082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.307362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.307667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.308382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.309950 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893de7-432e-4bc4-af7a-748a45f34a41 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.320534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1287/2564] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:36.324490 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.334550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25027-4a50-4bb1-ac25-1c661536c4cf admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.339131 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.340014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.340298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.340575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] PATH_INFO: `/v3/projects/c27e8068b4ef42209aedba66a73c0528/users/58e9cdb5590f4fdf9b051fea4056a45c/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.354931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27e8068b4ef42209aedba66a73c0528, user_id=58e9cdb5590f4fdf9b051fea4056a45c, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.357659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.375468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1278/2565] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:36 2022] PUT /identity/v3/projects/c27e8068b4ef42209aedba66a73c0528/users/58e9cdb5590f4fdf9b051fea4056a45c/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:36.386434 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.386724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.387002 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.413252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] MFA Rules not processed for user `58e9cdb5590f4fdf9b051fea4056a45c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:36.414498 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:36.482145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1288/2566] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:36.487310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.557022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc41f4-b141-4333-81fc-bb4010a030d6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.561646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.562530 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.562930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.563092 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.563820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.565711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.592068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1279/2567] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:36.596770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.609100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8d131-a8d2-4936-a5c3-76778db3d6c9 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.671701 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.672426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.672717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.672996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.673726 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.675664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.701426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1289/2568] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:36.702955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.710273 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:36.714207 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820695-d233-4c9e-bf68-42229a0ae9a7 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.720838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.721514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.721803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.722116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.722845 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.724495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.736189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1280/2569] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:36.740306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.750893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101395dd-352b-4a25-9956-3b233874c458 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.755621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.756494 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.756776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.757043 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] PATH_INFO: `/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8/users/63676e816fcb4b1bbcc3bb5af1fd94f9/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.775395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa50ff3f25714cd4b17745fcb327e2f8, user_id=63676e816fcb4b1bbcc3bb5af1fd94f9, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.778102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.781996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:36.792989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1290/2570] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:36 2022] PUT /identity/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8/users/63676e816fcb4b1bbcc3bb5af1fd94f9/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:36.797831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.807657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c23a-1399-48a6-90e9-4d2856b4ed63 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.863427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.864107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.864392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.864670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.865384 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.866966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b51da-5995-4cac-bb87-383e15ddac63 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.876472 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1281/2571] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:36.880672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:36.891220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d6b3-23e0-4e57-9f22-a04d5334cbd9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:36.895810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:36.896715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.896944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.897213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] PATH_INFO: `/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8/users/63676e816fcb4b1bbcc3bb5af1fd94f9/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.899141 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa50ff3f25714cd4b17745fcb327e2f8, user_id=63676e816fcb4b1bbcc3bb5af1fd94f9, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:36.901790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:36.912398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1291/2572] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:36 2022] PUT /identity/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8/users/63676e816fcb4b1bbcc3bb5af1fd94f9/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:36.923175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:36.923467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:36.923799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:36.949390 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] MFA Rules not processed for user `63676e816fcb4b1bbcc3bb5af1fd94f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:36.950861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:37.020564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1282/2573] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:37.032396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:37.034100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:37.088466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba198ab-0a6a-41bb-aa0e-5e4b32fcff68 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:37.092030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:37.092655 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:37.093594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:37.093867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:37.146376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:37.147893 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:37.156998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1292/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:38.626321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:38.627778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:38.641107 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a3b8-9236-4bd9-b124-9242563c4e8c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:38.644726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:38.645379 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:38.645666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:38.645945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:38.708151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:38.709600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:38.719524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1283/2575] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:39.355050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:39.365110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8587b2-6b52-4238-9b8f-e0f5305986c7 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:39.368954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:39.369629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:39.370024 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:39.370316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:39.381818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:39.383461 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:39.393721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1293/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:43.230887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:43.232380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:43.245688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:43.246118 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:43.291004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e935f-a15a-422d-b9f7-d3226bf32a9d service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:43.294705 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:43.295351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:43.295667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:43.295939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:43.297833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:43.311251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd97e-863f-4bff-9b43-a54ba68e4fa2 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:43.316480 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:43.317340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:43.317624 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:43.317906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] PATH_INFO: `/v3/users/dda9dc24e29444a9b4cc1980253ea83c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:43.319127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda9dc24e29444a9b4cc1980253ea83c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:43.321080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:43.352424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:43.363931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:43.365410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31f2a-20d5-4352-9a6d-5726de983283 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:43.372688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda9dc24e29444a9b4cc1980253ea83c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.373350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda9dc24e29444a9b4cc1980253ea83c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.374052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda9dc24e29444a9b4cc1980253ea83c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.375891 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1284/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:43.386625 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda9dc24e29444a9b4cc1980253ea83c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.400402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda9dc24e29444a9b4cc1980253ea83c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.413411 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1294/2578] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:43 2022] DELETE /identity/v3/users/dda9dc24e29444a9b4cc1980253ea83c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:43.417868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:43.418162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:43.418443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:43.435516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:43.437274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:43.496478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1285/2579] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:43.507060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:43.508718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:43.566252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3f97-5b25-4748-a05e-66eb66e00fbf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:43.569997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:43.570640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:43.570923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:43.571201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:43.581470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:43.582918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:43.593003 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1295/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:43.877524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:43.879012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:43.893355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e75153-65f4-436f-b848-5c99cd3897d2 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:43.898260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:43.899202 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:43.899578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:43.899930 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] PATH_INFO: `/v3/projects/e4fac1c7341e476e830c8d887dff4893` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:43.901189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fac1c7341e476e830c8d887dff4893)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:43.903163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:43.954895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fac1c7341e476e830c8d887dff4893', 'request_id': 'req-bafbb3b2-1240-4f11-9499-a533cb12f0c1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.960992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fac1c7341e476e830c8d887dff4893', 'request_id': 'req-bafbb3b2-1240-4f11-9499-a533cb12f0c1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.963234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:43.969538 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fac1c7341e476e830c8d887dff4893', 'request_id': 'req-bafbb3b2-1240-4f11-9499-a533cb12f0c1'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.984377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] The token cache is being invalidate because project e4fac1c7341e476e830c8d887dff4893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:43.984675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.985341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:43.990826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1286/2581] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:43 2022] DELETE /identity/v3/projects/e4fac1c7341e476e830c8d887dff4893 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:43.992459 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:44.006296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4b64-21f5-4e86-ab92-c9734b161293 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:44.067798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:44.068700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:44.069050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:44.069398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] PATH_INFO: `/v3/users/58e9cdb5590f4fdf9b051fea4056a45c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:44.070720 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e9cdb5590f4fdf9b051fea4056a45c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:44.072795 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:44.122028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e9cdb5590f4fdf9b051fea4056a45c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.122688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e9cdb5590f4fdf9b051fea4056a45c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.123294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e9cdb5590f4fdf9b051fea4056a45c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.125313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:44.131866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e9cdb5590f4fdf9b051fea4056a45c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.146409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e9cdb5590f4fdf9b051fea4056a45c'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.159722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1296/2582] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:43 2022] DELETE /identity/v3/users/58e9cdb5590f4fdf9b051fea4056a45c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:44.441377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:44.442851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:44.458012 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb3b2-1240-4f11-9499-a533cb12f0c1 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:44.536166 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:44.537051 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:44.537336 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:44.537745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] PATH_INFO: `/v3/projects/c27e8068b4ef42209aedba66a73c0528` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:44.549732 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27e8068b4ef42209aedba66a73c0528)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:44.553525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:44.630270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27e8068b4ef42209aedba66a73c0528', 'request_id': 'req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.638618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27e8068b4ef42209aedba66a73c0528', 'request_id': 'req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.649261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27e8068b4ef42209aedba66a73c0528', 'request_id': 'req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.665270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] The token cache is being invalidate because project c27e8068b4ef42209aedba66a73c0528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:44.665639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.666355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.668391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1287/2583] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:44 2022] DELETE /identity/v3/projects/c27e8068b4ef42209aedba66a73c0528 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:44.672359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:44.673868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:44.688146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4ea5e-2f59-4c98-b129-c6fc5d142348 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:44.748212 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:44.748984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:44.749796 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:44.750067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] PATH_INFO: `/v3/users/63676e816fcb4b1bbcc3bb5af1fd94f9` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:44.751258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63676e816fcb4b1bbcc3bb5af1fd94f9)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:44.753221 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:44.799429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63676e816fcb4b1bbcc3bb5af1fd94f9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.800176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63676e816fcb4b1bbcc3bb5af1fd94f9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.800861 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63676e816fcb4b1bbcc3bb5af1fd94f9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.808089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63676e816fcb4b1bbcc3bb5af1fd94f9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.820952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-79a40973-faf4-478a-b4c0-613436e6c71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63676e816fcb4b1bbcc3bb5af1fd94f9'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:44.834440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1297/2584] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:44 2022] DELETE /identity/v3/users/63676e816fcb4b1bbcc3bb5af1fd94f9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:45.123691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.125799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:45.141481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcd8a6-3b87-4eb6-b73e-1c625a5e6f8d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.217222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.218880 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.223628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.223628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] PATH_INFO: `/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.224749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa50ff3f25714cd4b17745fcb327e2f8)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.226914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.246902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:45.284929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa50ff3f25714cd4b17745fcb327e2f8', 'request_id': 'req-73a9a917-a788-4f4f-a222-42b19c58a4ac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:45.291195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa50ff3f25714cd4b17745fcb327e2f8', 'request_id': 'req-73a9a917-a788-4f4f-a222-42b19c58a4ac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:45.297196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa50ff3f25714cd4b17745fcb327e2f8', 'request_id': 'req-73a9a917-a788-4f4f-a222-42b19c58a4ac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:45.312547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] The token cache is being invalidate because project aa50ff3f25714cd4b17745fcb327e2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:45.312853 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:45.313422 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-73a9a917-a788-4f4f-a222-42b19c58a4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:45.315301 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1288/2585] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:45 2022] DELETE /identity/v3/projects/aa50ff3f25714cd4b17745fcb327e2f8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:45.319998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.320286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.320571 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.340236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:45.341472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:45.389160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:45.412454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1298/2586] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:45.420351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.420645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.420956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.440029 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:45.441014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:45.450481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1289/2587] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:45.455189 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.465120 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c10a5-08a2-4e86-abd4-fa01f2836def None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.470375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.471039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.471324 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.471642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.472362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:45.472670 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.474325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.486925 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1299/2588] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:45.490970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.501634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a07e1-ab6b-4456-a4b8-a091eff6de7c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.507481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.508286 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.508734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.509022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.509831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.513847 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.539629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1290/2589] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:45 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:45.543778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.555227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aecf62-a115-4801-9860-c86ba612587e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.618730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.619394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.619708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.619984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.620669 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.622584 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.644643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1300/2590] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:45 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:45.648578 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.661549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862363-d31e-40cf-83db-453cd535dc24 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.666540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.667304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.667679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.668019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.668830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.670484 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.684899 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1291/2591] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:45.686195 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.697020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4e07-f221-43ad-8371-494e3a557e48 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.702217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.703433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.703766 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.704044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.704765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.706352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2249-07ca-48dd-844f-1d85a69504b6 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.716429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1301/2592] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:45.720570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.730514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4737a18-12aa-4bc9-a678-cd43249341e2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.735138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.736035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.736316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.736588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] PATH_INFO: `/v3/projects/d919c5ea4cf74ce5a0ab00f73dac9762/users/690d0242393d4c078f7203c85e29c85a/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.752229 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d919c5ea4cf74ce5a0ab00f73dac9762, user_id=690d0242393d4c078f7203c85e29c85a, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.754894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.768719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1292/2593] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:45 2022] PUT /identity/v3/projects/d919c5ea4cf74ce5a0ab00f73dac9762/users/690d0242393d4c078f7203c85e29c85a/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:45.778883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.779180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.779463 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.810092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] MFA Rules not processed for user `690d0242393d4c078f7203c85e29c85a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:45.812139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:45.889491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1302/2594] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:45.900816 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:45.902657 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:45.969754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efae4e-bf49-419d-be11-b8ba8d414d2a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:45.973387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:45.974023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:45.974304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:45.974577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:45.984152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:45.985583 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665bac-076f-478c-80a7-bf13595d48cc service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:45.994548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1293/2595] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:46.019154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:46.072430 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:46.092995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec180-3d51-475a-8393-634e4c25d38c None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:46.098211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:46.099137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:46.099446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:46.099743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] PATH_INFO: `/v3/users/690d0242393d4c078f7203c85e29c85a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:46.101318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690d0242393d4c078f7203c85e29c85a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:46.103026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:46.157042 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690d0242393d4c078f7203c85e29c85a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.157824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690d0242393d4c078f7203c85e29c85a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.158391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690d0242393d4c078f7203c85e29c85a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.167692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690d0242393d4c078f7203c85e29c85a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.185537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690d0242393d4c078f7203c85e29c85a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.205152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1303/2596] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:46 2022] DELETE /identity/v3/users/690d0242393d4c078f7203c85e29c85a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:46.209726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cca1e-b40f-4582-9448-351615133578 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:46.210026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cca1e-b40f-4582-9448-351615133578 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:46.210331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cca1e-b40f-4582-9448-351615133578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:46.243951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-156cca1e-b40f-4582-9448-351615133578 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:46.245184 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-156cca1e-b40f-4582-9448-351615133578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:46.308863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:46.328601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1294/2597] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:46.338819 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:46.340249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:46.426802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af442c76-cbab-486f-9879-eac62ec16782 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:46.433372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:46.434156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:46.434507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:46.435047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:46.451095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:46.453476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:46.465983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1304/2598] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:46.726082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cca1e-b40f-4582-9448-351615133578 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:46.727738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-156cca1e-b40f-4582-9448-351615133578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:46.749364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cca1e-b40f-4582-9448-351615133578 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:46.755174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:46.756524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:46.756909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:46.757190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] PATH_INFO: `/v3/users/b470e4bbcf67422c860831db2f2d61af` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:46.758507 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b470e4bbcf67422c860831db2f2d61af)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:46.760545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:46.818192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b470e4bbcf67422c860831db2f2d61af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.832953 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b470e4bbcf67422c860831db2f2d61af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.833865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b470e4bbcf67422c860831db2f2d61af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.834610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b470e4bbcf67422c860831db2f2d61af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.844913 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b470e4bbcf67422c860831db2f2d61af'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:46.859436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1295/2599] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:46 2022] DELETE /identity/v3/users/b470e4bbcf67422c860831db2f2d61af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:47.039269 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.057471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21639f-a05a-48f5-8fc5-514afd32599a service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.104521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.106204 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.127942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.128811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.129168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.129516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] PATH_INFO: `/v3/projects/a7c8d946d999424495e9965305422667` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.130776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c8d946d999424495e9965305422667)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.132857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.135280 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:47.183039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c8d946d999424495e9965305422667', 'request_id': 'req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.191365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273a93-869e-4c48-bc9a-3efd1b5798d5 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.192210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c8d946d999424495e9965305422667', 'request_id': 'req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.198462 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c8d946d999424495e9965305422667', 'request_id': 'req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.210763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] The token cache is being invalidate because project a7c8d946d999424495e9965305422667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:47.211056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.211738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-5bf25b33-5b32-47c0-8155-ef6282ef4b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.213286 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1305/2600] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:47 2022] DELETE /identity/v3/projects/a7c8d946d999424495e9965305422667 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:47.218354 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57747930-88d6-4cff-aa9b-0f230729dc15 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.218640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57747930-88d6-4cff-aa9b-0f230729dc15 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.218919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57747930-88d6-4cff-aa9b-0f230729dc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.236963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-57747930-88d6-4cff-aa9b-0f230729dc15 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.238184 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-57747930-88d6-4cff-aa9b-0f230729dc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.251915 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.252767 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.253049 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.253326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] PATH_INFO: `/v3/projects/d919c5ea4cf74ce5a0ab00f73dac9762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.254495 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d919c5ea4cf74ce5a0ab00f73dac9762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.256447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.262656 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:47.299076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1306/2601] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:47.305893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd919c5ea4cf74ce5a0ab00f73dac9762', 'request_id': 'req-5cecc04f-3143-446a-8b3a-e48ced546d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.306673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.306979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.307239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.312982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd919c5ea4cf74ce5a0ab00f73dac9762', 'request_id': 'req-5cecc04f-3143-446a-8b3a-e48ced546d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.318738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd919c5ea4cf74ce5a0ab00f73dac9762', 'request_id': 'req-5cecc04f-3143-446a-8b3a-e48ced546d9f'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.325555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.326665 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.331758 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] The token cache is being invalidate because project d919c5ea4cf74ce5a0ab00f73dac9762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:47.332050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.332711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-5cecc04f-3143-446a-8b3a-e48ced546d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:47.334274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1296/2602] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:47 2022] DELETE /identity/v3/projects/d919c5ea4cf74ce5a0ab00f73dac9762 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:47.338868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.339156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.339438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.357636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.359371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.389870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1307/2603] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:47.393993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.402615 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f596e-66e2-4ff4-b33d-6b6a7a4081da None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.407572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.408215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.408500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.408773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.409485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:47.409790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.411374 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed809-fb23-4013-91a4-1dea8a3838ef admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.419773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1297/2604] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:47.427099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1308/2605] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:47.428412 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.439898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf2215-e424-494a-bb7b-c4ee4d5911fb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.444900 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.445615 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.445902 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.446181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.446893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.448905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.478550 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1298/2606] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:47.482451 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.483048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.483926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.484205 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.503077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.504366 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.517530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:47.545544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d373-f155-4405-9a53-be99d2372e93 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.550852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.551528 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.551826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.552108 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.552787 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.554881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.565473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1309/2607] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:47.570163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.579328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1299/2608] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:47.580384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57f329-b20a-4ca1-8a74-10f62f8ac0d3 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.583447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.585156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.585790 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.586066 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.586337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.587078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:47.587395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.588335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:47.588986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.595455 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d16061-a2cd-4fce-a95b-a24614553a3d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.601646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.602362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1310/2609] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:12:47.602486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.602797 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.603081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.603914 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.605501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.606791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.616447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1300/2610] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:47.617041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a9aab-a88c-43ef-8ca6-6dbcb0d48e30 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.620283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.621984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.622617 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.622902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.623178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.624744 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.626644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.630746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521e190-3bf7-44e4-9145-f3592f59ff39 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.635986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.636619 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.636905 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.637188 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.637897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.639564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.651182 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1301/2611] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:47.653431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1311/2612] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:47.655316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.657360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.665258 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d5cf-ce8a-4bd6-8853-a925219867d0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.723864 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9900-586b-4eb4-b597-6a5fb3b2d40e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.728512 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.728673 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.729177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.729465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.729607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.729746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.729861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.730124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] PATH_INFO: `/v3/projects/750a83cdce3446049dda2d2b33e05424/users/56eeedbee8b949b8aef31dcff39b0c94/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.730428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.732391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.746789 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750a83cdce3446049dda2d2b33e05424, user_id=56eeedbee8b949b8aef31dcff39b0c94, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.749996 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d31c2-552e-4df7-82b0-9003e4e8d051 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.753239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1312/2613] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:47.758130 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.763674 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1302/2614] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:47 2022] PUT /identity/v3/projects/750a83cdce3446049dda2d2b33e05424/users/56eeedbee8b949b8aef31dcff39b0c94/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:47.768895 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.769186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.769463 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.770051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ca570-6add-4e16-9a36-6fcd18f0cbac admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.787836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.789231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.832240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.832882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.833216 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.833523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.834270 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.836605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.849142 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1313/2615] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:47.853203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.864975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352a26-fa6c-431b-98fc-563d7c1e19c1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.869939 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.870822 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.870972 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1303/2616] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:47.871094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.871191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.871919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.873524 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.880939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.881678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:47.882348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.892000 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1314/2617] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:47.894009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:47.906555 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743ccc-474d-493e-b65f-df56e96e245f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.911667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:47.912572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.912865 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.913147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] PATH_INFO: `/v3/projects/5dc8fc57096e43c4838e8674652ea662/users/ef9c2b94381c4affb9800c66a7434793/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.930808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc8fc57096e43c4838e8674652ea662, user_id=ef9c2b94381c4affb9800c66a7434793, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:47.933680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b526b-0847-4b47-beff-54112c44cf33 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:47.947419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1315/2618] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:47 2022] PUT /identity/v3/projects/5dc8fc57096e43c4838e8674652ea662/users/ef9c2b94381c4affb9800c66a7434793/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:47.952818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:47.953102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:47.953376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:47.955017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf53fb-34dc-4963-af55-eaaaed1a8be6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:47.969856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:47.971035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:47.971830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:48.007094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:48.007759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:48.008046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:48.008324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:48.031122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1316/2619] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:48.040879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:48.052761 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f10892-780f-4a59-a55b-5cc71478f1df None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:48.056419 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:48.057052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:48.057333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:48.057609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:48.067873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:48.069317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3912b-0d05-47df-867b-ddc3c7377cb2 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:48.070624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:48.072086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c89cc-3e28-40a8-8352-3bd8fb87de46 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:48.079329 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1317/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:12:48.082177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1304/2621] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:49.316518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.318217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.318732 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.345901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.345901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.345901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.357362 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] MFA Rules not processed for user `ef9c2b94381c4affb9800c66a7434793`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:49.359468 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:49.375014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] MFA Rules not processed for user `56eeedbee8b949b8aef31dcff39b0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:49.376317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:49.460671 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1318/2622] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:49.464552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1305/2623] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:49.469847 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.472602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.474157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:49.485399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c79c09-014f-49c1-9752-d92306c179ea None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.490854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.491760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.492051 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.492333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.493049 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.495011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.531929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1319/2624] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:49 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:49.533111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.557064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0ed1-aa93-4339-8221-9eaf81bfece3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.576508 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:49.579426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:49.624965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.625692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.626047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.626394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.636869 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e75f-48b8-45db-8cd4-f5ad2396fec3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.643342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.644119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.644400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.644672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.645360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.647550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.689180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1320/2625] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:49 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:49.696025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.710577 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8465369-459d-4723-aba5-b793a3112f60 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.710854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.712555 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.721947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.722632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.722985 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.723306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.724304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.726098 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.741437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1321/2626] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:49.743697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1306/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:49.745393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.757343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d7ffe-6318-4474-9f71-a040a0c5e3aa admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.762265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.763144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.763423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.763729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] PATH_INFO: `/v3/projects/2cc60ef6fc914398b92b10bc9cf90401/users/50761c4dbe5a4f0a94bd92c6d322a84b/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.780826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc60ef6fc914398b92b10bc9cf90401, user_id=50761c4dbe5a4f0a94bd92c6d322a84b, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.783962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.798408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1322/2628] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:49 2022] PUT /identity/v3/projects/2cc60ef6fc914398b92b10bc9cf90401/users/50761c4dbe5a4f0a94bd92c6d322a84b/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:49.802699 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.816013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef4dd-d753-48bb-a720-4d5e8008a31b service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.873741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.874382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.874649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.874929 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.876104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.877890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea9f2-4c0c-429f-9de5-c706065c16ad admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.888545 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1307/2629] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:49.893702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:49.907825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e668c-a12d-4b8d-ae81-7e0f3e1c77a3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:49.912578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:49.913471 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:49.913749 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:49.914047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] PATH_INFO: `/v3/projects/2cc60ef6fc914398b92b10bc9cf90401/users/50761c4dbe5a4f0a94bd92c6d322a84b/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:49.916627 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc60ef6fc914398b92b10bc9cf90401, user_id=50761c4dbe5a4f0a94bd92c6d322a84b, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:49.919587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd76d9-9f0e-4677-8a27-3a70978c65b0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:49.931137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1323/2630] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:49 2022] PUT /identity/v3/projects/2cc60ef6fc914398b92b10bc9cf90401/users/50761c4dbe5a4f0a94bd92c6d322a84b/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:50.564948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:50.565462 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:50.565554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:50.592919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] MFA Rules not processed for user `50761c4dbe5a4f0a94bd92c6d322a84b`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:50.594332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:50.646955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:50.665145 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1308/2631] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:51.096046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:51.096522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:51.096637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:51.115239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] MFA Rules not processed for user `ef9c2b94381c4affb9800c66a7434793`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:51.116488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:51.181794 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1324/2632] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:51.620926 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:51.622903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:51.693656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:51.709413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e190710-e26b-4873-bab8-5c556695e787 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:51.717287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:51.718289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:51.718577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:51.718858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:51.720897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:51.733557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:51.735478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:51.746290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1309/2633] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:51.822429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ea0c9-e945-46d9-80cb-9fcbd56c11ab None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:51.827827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:51.828699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:51.828983 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:51.829260 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] PATH_INFO: `/v3/users/56eeedbee8b949b8aef31dcff39b0c94` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:51.830451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56eeedbee8b949b8aef31dcff39b0c94)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:51.832418 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:51.853291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:51.881478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56eeedbee8b949b8aef31dcff39b0c94'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:51.882210 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56eeedbee8b949b8aef31dcff39b0c94'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:51.883041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56eeedbee8b949b8aef31dcff39b0c94'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:51.891339 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56eeedbee8b949b8aef31dcff39b0c94'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:51.904233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56eeedbee8b949b8aef31dcff39b0c94'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:51.918116 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1325/2634] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:51 2022] DELETE /identity/v3/users/56eeedbee8b949b8aef31dcff39b0c94 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:52.097124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:52.111935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc016fc-452f-441d-8a40-f9c2e34a829a service placement] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:52.172148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:52.173017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.173287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.173559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] PATH_INFO: `/v3/projects/750a83cdce3446049dda2d2b33e05424` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.174749 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=750a83cdce3446049dda2d2b33e05424)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:52.176680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:52.235195 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750a83cdce3446049dda2d2b33e05424', 'request_id': 'req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.251676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750a83cdce3446049dda2d2b33e05424', 'request_id': 'req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.258631 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750a83cdce3446049dda2d2b33e05424', 'request_id': 'req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.273572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] The token cache is being invalidate because project 750a83cdce3446049dda2d2b33e05424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:52.273861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.274564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.276186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1310/2635] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:52 2022] DELETE /identity/v3/projects/750a83cdce3446049dda2d2b33e05424 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:52.280623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:52.282057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:52.295047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6f5d5-1cad-488f-b582-86377a665e59 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:52.353211 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:52.353988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.354265 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.354694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] PATH_INFO: `/v3/users/50761c4dbe5a4f0a94bd92c6d322a84b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.355778 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50761c4dbe5a4f0a94bd92c6d322a84b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:52.357697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:52.406227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50761c4dbe5a4f0a94bd92c6d322a84b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.407453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50761c4dbe5a4f0a94bd92c6d322a84b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.408093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50761c4dbe5a4f0a94bd92c6d322a84b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.415131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50761c4dbe5a4f0a94bd92c6d322a84b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.427399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e39e2ed8-f123-4243-9e0c-3dacce5e9843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50761c4dbe5a4f0a94bd92c6d322a84b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.439424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1326/2636] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:52 2022] DELETE /identity/v3/users/50761c4dbe5a4f0a94bd92c6d322a84b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:52.609747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:52.611245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:52.624170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53b51-3e5c-4908-b259-5d9f67afdb4d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:52.639854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:52.692983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:52.694030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.694341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.694748 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] PATH_INFO: `/v3/projects/2cc60ef6fc914398b92b10bc9cf90401` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.696021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc60ef6fc914398b92b10bc9cf90401)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:52.697927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:52.748355 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc60ef6fc914398b92b10bc9cf90401', 'request_id': 'req-23f3e3cf-5c30-4c21-acc4-621694329ac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.756795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc60ef6fc914398b92b10bc9cf90401', 'request_id': 'req-23f3e3cf-5c30-4c21-acc4-621694329ac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.765755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc60ef6fc914398b92b10bc9cf90401', 'request_id': 'req-23f3e3cf-5c30-4c21-acc4-621694329ac3'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.780728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] The token cache is being invalidate because project 2cc60ef6fc914398b92b10bc9cf90401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:52.781073 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.781764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-23f3e3cf-5c30-4c21-acc4-621694329ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:52.783704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1311/2637] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:52 2022] DELETE /identity/v3/projects/2cc60ef6fc914398b92b10bc9cf90401 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:52.788636 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.789040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.789394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.809826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:52.811077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:52.822777 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:52.901209 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1327/2638] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:52.909471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.910083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.910564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.930105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:52.931328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:52.939365 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1312/2639] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:52.943745 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:52.954188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deaa64-0288-490f-ac96-e6b6893f5163 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:52.958848 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:52.959619 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.959967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.960310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.961102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:52.961479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:52.963145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:52.975908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1328/2640] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:52.980429 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:52.990588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d0e86-e262-47cc-9ccf-97e9fb9d4d0b None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:52.995257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:52.995932 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:52.996223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:52.996504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:52.997304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.000005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.029054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1313/2641] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:52 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:53.030258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.040015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa6e04-abfc-4e27-b73a-1b588024defe admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.105061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.105851 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.106228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.106529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.107282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.109317 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.129596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1329/2642] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:12:53.133646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.144646 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b731b-1e10-4749-81db-339710ba7488 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.149710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.150452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.150743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.151022 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.151785 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.153401 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.164676 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1314/2643] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:53.168836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.179578 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce7c6-fbf2-4dd6-90e1-3abfacd265a7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.184752 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.185408 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.185695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.186499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.187228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.189016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4d243-acf0-4098-af4d-2d6e71c56c49 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.201067 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1330/2644] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:53.206142 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.218534 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c682d-9c3b-45ad-a528-db0347fcd7bc admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.224268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.225276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.225626 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.225829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] PATH_INFO: `/v3/projects/32778928ebf742388fc7ad7a8eff100e/users/20ff6106659e4fe6991cf9cd2820d21b/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.241521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32778928ebf742388fc7ad7a8eff100e, user_id=20ff6106659e4fe6991cf9cd2820d21b, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.244222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.258297 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1315/2645] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:53 2022] PUT /identity/v3/projects/32778928ebf742388fc7ad7a8eff100e/users/20ff6106659e4fe6991cf9cd2820d21b/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:53.270540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.270833 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.271115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.297501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] MFA Rules not processed for user `20ff6106659e4fe6991cf9cd2820d21b`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:53.298743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:53.369755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1331/2646] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:53.374600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.417843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:53.442531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0170750-6615-46cc-95e2-2a0aeb669288 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.447045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.447730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.448032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.448302 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.448989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.451198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.477417 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1316/2647] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:53.481675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.493081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791f7f5-240c-4e5d-abab-68268c90594e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.501605 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:53.554282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.554818 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.555145 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.555695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.556438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.558350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.582256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1332/2648] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:53.583470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.593822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5bb9a-d396-4ec6-8cbd-859a68c095b8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.598804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.599468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.599831 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.600084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.600941 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.602722 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.617747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1317/2649] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:53.618966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.629821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145194a-e3b0-4e34-a6a6-a814a8be7f00 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.634894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.635603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.635890 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.636193 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.636919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.638516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8c794-8eda-42c5-8fff-3d0b13a4557c admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.648741 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1333/2650] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:53.652957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.663989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dbfb2-3dc9-4274-8cea-c0feae4391d8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.668647 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.669599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.669970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.670860 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] PATH_INFO: `/v3/projects/1a881a9554e74393bb2532272bca4e90/users/a0a332b8e41f49fca3fd63746d55292d/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.686884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a881a9554e74393bb2532272bca4e90, user_id=a0a332b8e41f49fca3fd63746d55292d, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.689584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.704679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1318/2651] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:53 2022] PUT /identity/v3/projects/1a881a9554e74393bb2532272bca4e90/users/a0a332b8e41f49fca3fd63746d55292d/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:53.715018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.715378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.715754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.750428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] MFA Rules not processed for user `a0a332b8e41f49fca3fd63746d55292d`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:53.751830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:53.828500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1334/2652] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:53.833688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.902385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f884-a195-4e28-b7b6-d5a448602136 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:53.909488 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:53.910126 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:53.910413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:53.910692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:53.911397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:53.913343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:53.948690 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1319/2653] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:53.949662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:53.966083 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea980c-8aeb-43f7-a6a1-a0edcb3e71c1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.042988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.043771 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.044096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.044378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.045108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.048025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.070928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1335/2654] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:53 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:54.072364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.083325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abbff-5c35-40d3-8599-26850247b63b admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.088176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.088903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.089261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.089610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.090403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.092129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.104828 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1320/2655] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:54.109641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.120018 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479c1c7-0d36-4688-b793-3164562f6580 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.124988 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.125940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.126290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.126634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] PATH_INFO: `/v3/projects/3f3f0e6a485943669b0461b9558d4776/users/af6ddaed7c974e47833d2649dfa5fd75/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.129994 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:54.145090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3f0e6a485943669b0461b9558d4776, user_id=af6ddaed7c974e47833d2649dfa5fd75, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.147952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.169244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1336/2656] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:54 2022] PUT /identity/v3/projects/3f3f0e6a485943669b0461b9558d4776/users/af6ddaed7c974e47833d2649dfa5fd75/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:54.172974 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.193846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3e58-c1e0-449b-8605-818124237c90 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.259907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.260575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.260863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.261147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.261872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.263469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9452fa-bded-4585-bbc0-f564cdcfc6bd admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.266110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:54.278197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1321/2657] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:12:54.280478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.291026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16bda5-dadc-4153-aa9a-cb2301fc4ea1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.295688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.296556 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.296837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.297107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] PATH_INFO: `/v3/projects/3f3f0e6a485943669b0461b9558d4776/users/af6ddaed7c974e47833d2649dfa5fd75/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.299139 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3f0e6a485943669b0461b9558d4776, user_id=af6ddaed7c974e47833d2649dfa5fd75, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.301859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.312599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1337/2658] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:54 2022] PUT /identity/v3/projects/3f3f0e6a485943669b0461b9558d4776/users/af6ddaed7c974e47833d2649dfa5fd75/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:54.324096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.324649 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.324942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.352307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] MFA Rules not processed for user `af6ddaed7c974e47833d2649dfa5fd75`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:54.353660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:54.426570 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1322/2659] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:12:54.438114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.439786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:54.496952 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7d054-f275-480f-859d-e4be9e2675ba admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.501201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.502213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.502213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.502455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.511516 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.512979 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.523237 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1338/2660] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:54.563919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:54.565457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:54.579064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea473a-f381-4dd9-b755-40f5f8c4aece None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:54.583792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:54.584428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:54.584869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:54.585146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:54.645878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:54.647311 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86e17-401e-4682-89e2-98dc20c8a23f service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:54.656173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1323/2661] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:57.498061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:57.566694 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347e9a3-fe1e-44ae-9ee5-edb36eb13263 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:57.571249 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:57.572134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:57.572416 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:57.572693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] PATH_INFO: `/v3/users/20ff6106659e4fe6991cf9cd2820d21b` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:57.573874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ff6106659e4fe6991cf9cd2820d21b)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:57.576081 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:57.624845 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ff6106659e4fe6991cf9cd2820d21b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:57.625508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ff6106659e4fe6991cf9cd2820d21b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:57.626110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ff6106659e4fe6991cf9cd2820d21b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:57.634560 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ff6106659e4fe6991cf9cd2820d21b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:57.647705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ff6106659e4fe6991cf9cd2820d21b'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:57.652178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:57.662807 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1339/2662] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:57 2022] DELETE /identity/v3/users/20ff6106659e4fe6991cf9cd2820d21b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:57.667426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:57.667950 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:57.668064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:57.685639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:57.686875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:57.746152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1324/2663] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:57.756244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:57.757638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:57.813700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0d921-fa96-4ea7-8512-8ed763193898 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:57.817268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:57.817901 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:57.818182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:57.818457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:57.828029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:57.829447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:57.838616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1340/2664] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:12:58.101667 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:58.103387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:58.116478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67aea-5a78-4054-bdc9-3350d5aabd76 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:58.121254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:58.122376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:58.122740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:58.123894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] PATH_INFO: `/v3/projects/32778928ebf742388fc7ad7a8eff100e` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:58.125270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32778928ebf742388fc7ad7a8eff100e)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:58.127353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:58.144453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:58.174020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32778928ebf742388fc7ad7a8eff100e', 'request_id': 'req-169f716b-5e8a-4f86-af0d-848f26902e60'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.180104 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32778928ebf742388fc7ad7a8eff100e', 'request_id': 'req-169f716b-5e8a-4f86-af0d-848f26902e60'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.185620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32778928ebf742388fc7ad7a8eff100e', 'request_id': 'req-169f716b-5e8a-4f86-af0d-848f26902e60'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.200011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] The token cache is being invalidate because project 32778928ebf742388fc7ad7a8eff100e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:58.200306 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.201091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.203148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1325/2665] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:58 2022] DELETE /identity/v3/projects/32778928ebf742388fc7ad7a8eff100e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:58.207382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:58.219530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb55dc-e4ba-4d7b-8e75-f478ef46849a service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:58.281297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:58.282090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:58.282378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:58.282662 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] PATH_INFO: `/v3/users/a0a332b8e41f49fca3fd63746d55292d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:58.283906 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a332b8e41f49fca3fd63746d55292d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:58.285858 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:58.333486 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a332b8e41f49fca3fd63746d55292d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.334144 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a332b8e41f49fca3fd63746d55292d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.334915 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a332b8e41f49fca3fd63746d55292d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.343743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a332b8e41f49fca3fd63746d55292d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.357640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a332b8e41f49fca3fd63746d55292d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.372478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1341/2666] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:58 2022] DELETE /identity/v3/users/a0a332b8e41f49fca3fd63746d55292d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:12:58.658865 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:58.660450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:58.675921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f716b-5e8a-4f86-af0d-848f26902e60 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:58.735596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:58.736450 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:58.736734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:58.737011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] PATH_INFO: `/v3/projects/1a881a9554e74393bb2532272bca4e90` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:58.738192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a881a9554e74393bb2532272bca4e90)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:58.740123 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:58.786212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a881a9554e74393bb2532272bca4e90', 'request_id': 'req-2ecc7779-831f-48e7-83da-823d9f3933eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.792174 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a881a9554e74393bb2532272bca4e90', 'request_id': 'req-2ecc7779-831f-48e7-83da-823d9f3933eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.798266 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a881a9554e74393bb2532272bca4e90', 'request_id': 'req-2ecc7779-831f-48e7-83da-823d9f3933eb'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.812559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] The token cache is being invalidate because project 1a881a9554e74393bb2532272bca4e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:58.812850 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.813597 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.815330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1326/2667] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:58 2022] DELETE /identity/v3/projects/1a881a9554e74393bb2532272bca4e90 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:58.819252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:58.820729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:58.833664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01168-9a72-4de0-947f-457bcc81fde9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:58.845215 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:58.892626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:58.893485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:58.893770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:58.894047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] PATH_INFO: `/v3/users/af6ddaed7c974e47833d2649dfa5fd75` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:58.895218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6ddaed7c974e47833d2649dfa5fd75)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:58.897160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:58.942785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6ddaed7c974e47833d2649dfa5fd75'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.943436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6ddaed7c974e47833d2649dfa5fd75'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.944076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6ddaed7c974e47833d2649dfa5fd75'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.951401 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6ddaed7c974e47833d2649dfa5fd75'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.963110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e071b416-eda1-4612-a04c-13662c1a0753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6ddaed7c974e47833d2649dfa5fd75'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:58.975610 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1342/2668] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:12:58 2022] DELETE /identity/v3/users/af6ddaed7c974e47833d2649dfa5fd75 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:59.247351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.248820 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:59.261747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc7779-831f-48e7-83da-823d9f3933eb admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.298175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:59.323418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.324504 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.324792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.325068 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] PATH_INFO: `/v3/projects/3f3f0e6a485943669b0461b9558d4776` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.326231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3f0e6a485943669b0461b9558d4776)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.328668 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.373272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3f0e6a485943669b0461b9558d4776', 'request_id': 'req-80b64c79-179c-471a-9c72-f3d33af78607'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:59.379193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3f0e6a485943669b0461b9558d4776', 'request_id': 'req-80b64c79-179c-471a-9c72-f3d33af78607'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:59.384745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3f0e6a485943669b0461b9558d4776', 'request_id': 'req-80b64c79-179c-471a-9c72-f3d33af78607'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:59.397965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] The token cache is being invalidate because project 3f3f0e6a485943669b0461b9558d4776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:12:59.398255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:59.398876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-80b64c79-179c-471a-9c72-f3d33af78607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:12:59.400448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1327/2669] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:12:59 2022] DELETE /identity/v3/projects/3f3f0e6a485943669b0461b9558d4776 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:59.406886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.407196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.407472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.424953 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:59.426154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:59.482554 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1343/2670] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:59.490524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.490846 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.491128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.509069 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:59.510252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:59.518568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1328/2671] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:59.522721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.532722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746ef78-008a-49ce-9460-6c8fcd8071b4 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.537243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.537874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.538151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.538423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.539129 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:12:59.539428 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.541028 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.552971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1344/2672] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:12:59.557189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.566396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619df51-4b3b-44cf-b670-ef0e4fa6170a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.571157 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.571839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.572122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.572402 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.573084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.575314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.601424 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1329/2673] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:59.605506 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.615431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64dae4-332f-41f7-b0fa-b360234d8cf2 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.633328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:12:59.672271 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.672922 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.673201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.673475 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.674160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.676095 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.694832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1345/2674] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:12:59.698966 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.710172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37f64-b473-41e1-93df-bde9e7b05d8a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.714776 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.715432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.715750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.716054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.716801 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.719039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.730456 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1330/2675] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:59.734175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.744180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540bf10-c7d1-4497-9351-a952403085bf admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.749306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.749945 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.750228 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.750505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.751218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.752839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa975-2d15-42b4-9777-57ea1c8fb602 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.762746 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1346/2676] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:12:59.767305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.781373 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e1b9-f59d-4fbf-9a9b-786adae5f1a4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:12:59.786756 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:12:59.787678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.787956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.788225 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] PATH_INFO: `/v3/projects/81b1f349b5324d50aac57131a9890e6c/users/53a7f2033c8441c7a190dae472146e3f/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.805052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b1f349b5324d50aac57131a9890e6c, user_id=53a7f2033c8441c7a190dae472146e3f, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:12:59.807830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:12:59.820918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1331/2677] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:12:59 2022] PUT /identity/v3/projects/81b1f349b5324d50aac57131a9890e6c/users/53a7f2033c8441c7a190dae472146e3f/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:12:59.833027 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:12:59.833496 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:12:59.833603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:12:59.859337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] MFA Rules not processed for user `53a7f2033c8441c7a190dae472146e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:12:59.860603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:12:59.924825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1347/2678] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:12:59.929536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:12:59.997307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f70a5-4a11-4645-90b2-277958cdf10c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.002823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.003479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.003795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.004074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.004775 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.006659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.010937 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:00.035881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1332/2679] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:12:59 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:13:00.039909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.050916 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2e32b-cbbf-4f1e-9770-68a0fadd857b None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.110967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.111695 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.112012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.112288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.113017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.114943 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.135677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1348/2680] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:13:00 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:13:00.139653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.150164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377e08-5653-4580-a43d-d85fcf4b769f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.155007 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.155701 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.155987 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.156267 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.156993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.158640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.169873 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1333/2681] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:13:00.174515 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.184499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f9172-822d-4abe-8112-19782aad84f5 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.189827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.190827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.191250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.191561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] PATH_INFO: `/v3/projects/cba4c76cf046456f842528d44d8a8b82/users/f14ee1346e24425db0efa7e46961658d/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.206663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba4c76cf046456f842528d44d8a8b82, user_id=f14ee1346e24425db0efa7e46961658d, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.209566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.212870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:00.224056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1349/2682] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:13:00 2022] PUT /identity/v3/projects/cba4c76cf046456f842528d44d8a8b82/users/f14ee1346e24425db0efa7e46961658d/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:00.228287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.238823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94697277-82bf-4138-9b19-cc2211da78a4 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.296982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.297637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.297919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.298193 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.298907 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.300533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9202f-02c5-461c-8001-0ee7b0ba965a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.310074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1334/2683] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:13:00.315316 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.325692 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf8791-b0ad-4477-9e6d-3f6391fa1500 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.330334 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.331202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.331484 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.331793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] PATH_INFO: `/v3/projects/cba4c76cf046456f842528d44d8a8b82/users/f14ee1346e24425db0efa7e46961658d/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.333734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba4c76cf046456f842528d44d8a8b82, user_id=f14ee1346e24425db0efa7e46961658d, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.336399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.346433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1350/2684] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:13:00 2022] PUT /identity/v3/projects/cba4c76cf046456f842528d44d8a8b82/users/f14ee1346e24425db0efa7e46961658d/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:00.357247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.358063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.358351 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.384861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] MFA Rules not processed for user `f14ee1346e24425db0efa7e46961658d`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:00.386000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:00.452314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1335/2685] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:00.463870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.465606 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:00.524171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ad749-a4b9-44da-a803-8c89e49a1d06 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.527754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.528382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.528663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.528934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.538436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.539900 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.549933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1351/2686] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:00.634067 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:00.643934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ce8a-f2cb-4f41-b348-98cc8dc676b3 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:00.647367 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:00.648034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:00.648315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:00.648588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:00.703733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:00.705958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:00.707925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000191e-d514-441f-a719-6deae47cbd9e service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:00.718014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1336/2687] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:00.973824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:01.033949 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82d64d-a1b5-4648-9259-334387353a06 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:01.038423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:01.039281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:01.039586 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:01.039866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] PATH_INFO: `/v3/users/53a7f2033c8441c7a190dae472146e3f` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:01.041133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a7f2033c8441c7a190dae472146e3f)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:01.043201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:01.089393 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a7f2033c8441c7a190dae472146e3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.090055 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a7f2033c8441c7a190dae472146e3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.090673 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a7f2033c8441c7a190dae472146e3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.099240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a7f2033c8441c7a190dae472146e3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.112104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a7f2033c8441c7a190dae472146e3f'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.124488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1352/2688] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:00 2022] DELETE /identity/v3/users/53a7f2033c8441c7a190dae472146e3f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:01.129764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:01.130261 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:01.130815 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:01.149541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:01.150664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:01.213709 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1337/2689] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:01.224632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:01.226274 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:01.233493 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:01.287776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307153c-c2b5-43c4-a051-60f3ac2ed9ef admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:01.291882 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:01.292526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:01.292806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:01.293109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:01.302396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:01.303877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:01.314031 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1353/2690] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:01.600736 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:01.602295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:01.616779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f44dd4-1fb3-4ea3-b437-6cd8791d2324 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:01.621782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:01.622536 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:01.622805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:01.623659 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] PATH_INFO: `/v3/projects/81b1f349b5324d50aac57131a9890e6c` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:01.624871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b1f349b5324d50aac57131a9890e6c)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:01.626805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:01.694046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b1f349b5324d50aac57131a9890e6c', 'request_id': 'req-6f4b2122-e40b-4a54-8a27-50979a5e92d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.702342 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b1f349b5324d50aac57131a9890e6c', 'request_id': 'req-6f4b2122-e40b-4a54-8a27-50979a5e92d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.709549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b1f349b5324d50aac57131a9890e6c', 'request_id': 'req-6f4b2122-e40b-4a54-8a27-50979a5e92d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.722362 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] The token cache is being invalidate because project 81b1f349b5324d50aac57131a9890e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:01.722737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.723425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.725062 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1338/2691] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:01 2022] DELETE /identity/v3/projects/81b1f349b5324d50aac57131a9890e6c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:01.729548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:01.740427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6df77-5041-43bd-820b-57b3ef664b8b service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:01.799133 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:01.800041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:01.800328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:01.800609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] PATH_INFO: `/v3/users/f14ee1346e24425db0efa7e46961658d` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:01.802371 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14ee1346e24425db0efa7e46961658d)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:01.804406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:01.856857 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14ee1346e24425db0efa7e46961658d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.858039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14ee1346e24425db0efa7e46961658d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.858640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14ee1346e24425db0efa7e46961658d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.867727 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14ee1346e24425db0efa7e46961658d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.881786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e6f30325-ecdc-45af-8d7b-23ca3cceddf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14ee1346e24425db0efa7e46961658d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:01.895540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1354/2692] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:01 2022] DELETE /identity/v3/users/f14ee1346e24425db0efa7e46961658d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:02.192869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.194898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:02.219446 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2122-e40b-4a54-8a27-50979a5e92d6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.286795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.287706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.287989 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.288358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] PATH_INFO: `/v3/projects/cba4c76cf046456f842528d44d8a8b82` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.289541 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba4c76cf046456f842528d44d8a8b82)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.291618 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.316623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:02.343978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba4c76cf046456f842528d44d8a8b82', 'request_id': 'req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:02.350056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba4c76cf046456f842528d44d8a8b82', 'request_id': 'req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:02.355658 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba4c76cf046456f842528d44d8a8b82', 'request_id': 'req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:02.368593 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] The token cache is being invalidate because project cba4c76cf046456f842528d44d8a8b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:02.368884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:02.369547 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-3a1e7008-1626-4506-b3a6-c3e0c80ded1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:02.371122 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1339/2693] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:02 2022] DELETE /identity/v3/projects/cba4c76cf046456f842528d44d8a8b82 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:02.376223 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.376693 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.376805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.394648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:02.395929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:02.417926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:02.458785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1355/2694] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:02.466623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.467558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.467842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.487156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:02.488475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:02.496824 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1340/2695] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:02.501057 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.510810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4932-8c28-4df7-ab0f-65d6c0b97336 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.515964 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.516598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.516887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.517163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.517884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:13:02.518191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.519830 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.533162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1356/2696] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:13:02.537128 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.546553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d51b-394e-4195-81ed-788ad133cbff None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.551549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.552185 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.552464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.552747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.553457 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.555376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.581765 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1341/2697] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:13:02 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:13:02.585899 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.597063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2843-d1a8-42d6-9536-07665ff3868e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.652542 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.653375 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.653650 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.654035 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.655312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.657306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.679060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1357/2698] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:13:02 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:13:02.683231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.693684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61150039-1d48-4fce-aef1-93b48eca8cec admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.698394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.699382 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.699634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.699910 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.700710 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.703106 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.715072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1342/2699] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:13:02.726878 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.731832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517b45-3883-45b2-b609-6ac2e06a14b1 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.736473 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.737125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.737576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.737799 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.738532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.740460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42600-1c91-4a40-8456-706655beff86 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.751599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1358/2700] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:13:02.755840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.766595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c592-4353-40b9-b84d-0e13b21e6aa6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.771094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.772170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.772473 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.772766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] PATH_INFO: `/v3/projects/494e611ced494416a2964e3bfd25b465/users/eb85b379fb604649a616cb70178d3545/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.787965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=494e611ced494416a2964e3bfd25b465, user_id=eb85b379fb604649a616cb70178d3545, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.790604 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:02.804513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1343/2701] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:13:02 2022] PUT /identity/v3/projects/494e611ced494416a2964e3bfd25b465/users/eb85b379fb604649a616cb70178d3545/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:02.816821 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.817122 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.817402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.845296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] MFA Rules not processed for user `eb85b379fb604649a616cb70178d3545`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:02.846507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:02.911567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1359/2702] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:02.922074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:02.923766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:02.981181 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93190b-b12e-43b6-abeb-24c825378b3d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:02.984779 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:02.985426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:02.985713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:02.985993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:02.994257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:02.995718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7d7c-ffda-4520-b4c4-a6e9703af0c2 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:03.005483 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1344/2703] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:11.429593 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:11.456877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:11.500245 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c8faa-7410-444e-9f62-3cd436212301 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:11.504785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:11.505675 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:11.505961 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:11.506240 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] PATH_INFO: `/v3/users/eb85b379fb604649a616cb70178d3545` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:11.507456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb85b379fb604649a616cb70178d3545)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:11.509754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:11.558935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb85b379fb604649a616cb70178d3545'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:11.559629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb85b379fb604649a616cb70178d3545'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:11.560244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb85b379fb604649a616cb70178d3545'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:11.568190 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb85b379fb604649a616cb70178d3545'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:11.582217 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb85b379fb604649a616cb70178d3545'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:11.595918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1360/2704] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:11 2022] DELETE /identity/v3/users/eb85b379fb604649a616cb70178d3545 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:11.600542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:11.601338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:11.601338 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:11.620770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:11.621995 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:11.670144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:11.686884 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1345/2705] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:11.696529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:11.697926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:11.760340 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7b138-cae4-40a3-8c92-b7970e92490d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:11.763997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:11.764640 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:11.764921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:11.765203 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:11.774603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:11.776146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee06af0-46be-4157-9594-68b6f897c1f1 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:11.788131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1361/2706] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:12.079852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.081317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.100460 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5660f82-c7cb-44cd-b5bb-8975ef7b2c5c None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.105688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.106329 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.106682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.106883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] PATH_INFO: `/v3/projects/494e611ced494416a2964e3bfd25b465` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.108125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494e611ced494416a2964e3bfd25b465)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.110601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.163982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494e611ced494416a2964e3bfd25b465', 'request_id': 'req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:12.172497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494e611ced494416a2964e3bfd25b465', 'request_id': 'req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:12.178633 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494e611ced494416a2964e3bfd25b465', 'request_id': 'req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:12.194501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] The token cache is being invalidate because project 494e611ced494416a2964e3bfd25b465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:12.194917 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:12.195688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-7b08a89a-d9b1-479c-9c3f-8b8fe7825395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:12.198135 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1346/2707] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:12 2022] DELETE /identity/v3/projects/494e611ced494416a2964e3bfd25b465 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:12.203128 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.203492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.203889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.228638 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:12.229835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.276526 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:12.298090 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1362/2708] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:13:12.305958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.306323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.306695 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.325094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:12.326378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.336205 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1347/2709] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:13:12.340551 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.351162 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b1060-c171-418c-8a90-1fdd75bc2d57 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.355969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.356628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.356914 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.357194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.357921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:13:12.358230 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.359998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbd474-6eb6-421b-8983-e2196a29a7f7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.372639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1363/2710] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:13:12.376872 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.378175 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.378470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.378805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.386506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962026-a0de-4375-bb60-4fe63e13e4be None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.391678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.392322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.392605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.392882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.393573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.395471 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.396529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] MFA Rules not processed for user `2fef8e733a7d41d59fe3e86936e1a2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:12.397721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.424399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1348/2711] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:13:12.428727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.455368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1364/2712] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:13:12.492254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e351-5dd1-43f6-bb34-78491e34adcf admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.497956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.498693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.499047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.499399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.500697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.502609 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.526525 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1349/2713] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:13:12.530632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.542089 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697920-f27b-4df4-aed9-b7062d4abb07 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.546333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.547037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.547319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.547629 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.548357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.549947 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.560069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1365/2714] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:13:12.564526 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.574573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3441935-6af3-4be3-9a1d-553ce98b9ef2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.579918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.580576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.580858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.581132 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.581852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.583418 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047edb-d9c9-4938-99b6-94fc83cceae7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.597315 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1350/2715] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:13:12.598909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.608884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e274-97e4-47bb-a806-e42d37f9717b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.614169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.615077 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.615406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.615725 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] PATH_INFO: `/v3/projects/7aca8fe6c303443b9f6607bdd9799d60/users/32f15e66368749c2b055ec078b43d427/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.630652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aca8fe6c303443b9f6607bdd9799d60, user_id=32f15e66368749c2b055ec078b43d427, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.633390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.654728 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1366/2716] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:13:12 2022] PUT /identity/v3/projects/7aca8fe6c303443b9f6607bdd9799d60/users/32f15e66368749c2b055ec078b43d427/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:12.665300 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.665833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.665833 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.693036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] MFA Rules not processed for user `32f15e66368749c2b055ec078b43d427`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:12.694231 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.703942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:12.764635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1351/2717] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:12.775827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:12.777621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:12.836490 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4b86-91e3-4beb-90cc-64785172a5d7 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:12.840460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:12.841102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:12.841381 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:12.841651 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:12.851492 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:12.852887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c11d-7137-4b21-98d5-a19faa76029b service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:12.862296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1367/2718] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:15.953696 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:16.024377 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2938e00-9f4e-4a16-ab0c-4f891a18a77f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:16.031129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:16.032042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:16.032323 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:16.032754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] PATH_INFO: `/v3/users/32f15e66368749c2b055ec078b43d427` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:16.034060 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f15e66368749c2b055ec078b43d427)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:16.036464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:16.087713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f15e66368749c2b055ec078b43d427'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.099708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f15e66368749c2b055ec078b43d427'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.100419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f15e66368749c2b055ec078b43d427'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.101038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f15e66368749c2b055ec078b43d427'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.109826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f15e66368749c2b055ec078b43d427'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.122497 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1352/2719] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:15 2022] DELETE /identity/v3/users/32f15e66368749c2b055ec078b43d427 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:16.127824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:16.128348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:16.128448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:16.146330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:16.147565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:16.191731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:16.219380 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1368/2720] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:13:16.231875 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:16.233314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:16.271533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:16.301568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f63b-fd75-46a9-ac03-80075ab0db15 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:16.305241 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:16.305874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:16.306154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:16.306428 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:16.316489 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:16.317838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:16.327378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1353/2721] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:16.605844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:16.607309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:16.619255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ff25-9e04-4694-9252-32fe88b509be None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:16.623971 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:16.624825 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:16.625106 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:16.625385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] PATH_INFO: `/v3/projects/7aca8fe6c303443b9f6607bdd9799d60` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:16.626565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aca8fe6c303443b9f6607bdd9799d60)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:16.628585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:16.674633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aca8fe6c303443b9f6607bdd9799d60', 'request_id': 'req-a56a3834-afd7-4550-98e4-bb802e16072d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.681883 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aca8fe6c303443b9f6607bdd9799d60', 'request_id': 'req-a56a3834-afd7-4550-98e4-bb802e16072d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.687576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aca8fe6c303443b9f6607bdd9799d60', 'request_id': 'req-a56a3834-afd7-4550-98e4-bb802e16072d'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.698426 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] The token cache is being invalidate because project 7aca8fe6c303443b9f6607bdd9799d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:16.698978 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.699661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:16.701191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1369/2722] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:16 2022] DELETE /identity/v3/projects/7aca8fe6c303443b9f6607bdd9799d60 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:26.322957 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=12 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:26.695435 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:38.343481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:38.344898 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:38.355944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4c6b-ca1b-4f97-b3f5-20e6322de831 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:38.403348 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:38.404006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:38.404310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:38.404585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:38.406276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:38.461839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:38.463247 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:38.472234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1354/2723] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:45.081315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:45.082828 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:45.151497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a3834-afd7-4550-98e4-bb802e16072d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:45.156513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:45.157160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:45.157453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:45.157731 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:45.159639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:45.171105 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:45.172733 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:45.182764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1370/2724] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:45.595956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:45.597371 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:45.608293 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209a2-1c3f-4c41-a335-3638177569b5 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:45.612556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:45.613196 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:45.613481 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:45.613762 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:45.615494 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:45.678255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:45.679741 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:45.690020 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1355/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:13:51.630908 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:51.632452 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:51.645968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330898c-29b3-40fa-9d32-4ac498e5145c service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:51.650441 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:51.651299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:51.651612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:51.651918 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] PATH_INFO: `/v3/users/4ff924af30074a92960aace363617dea` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:51.653094 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff924af30074a92960aace363617dea)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:51.654997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:51.699912 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff924af30074a92960aace363617dea'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:51.700491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff924af30074a92960aace363617dea'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:51.701096 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff924af30074a92960aace363617dea'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:51.708172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff924af30074a92960aace363617dea'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:51.720146 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff924af30074a92960aace363617dea'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:51.732115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1371/2726] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:51 2022] DELETE /identity/v3/users/4ff924af30074a92960aace363617dea => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:51.905564 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:51.916542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eabb01-c913-4a37-8d41-2786c7b476f4 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:51.966713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:51.979755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:51.980598 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:51.980881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:51.981168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] PATH_INFO: `/v3/projects/8b8cba29e73c469d924aeaf9db1857e0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:51.982307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8cba29e73c469d924aeaf9db1857e0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:51.984240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:52.030127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8cba29e73c469d924aeaf9db1857e0', 'request_id': 'req-c8017d7b-ad5d-4e94-98c4-80db1730b72d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.036664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8cba29e73c469d924aeaf9db1857e0', 'request_id': 'req-c8017d7b-ad5d-4e94-98c4-80db1730b72d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.042109 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8cba29e73c469d924aeaf9db1857e0', 'request_id': 'req-c8017d7b-ad5d-4e94-98c4-80db1730b72d'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.054740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] The token cache is being invalidate because project 8b8cba29e73c469d924aeaf9db1857e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:52.055024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.055672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.057226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1356/2727] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:51 2022] DELETE /identity/v3/projects/8b8cba29e73c469d924aeaf9db1857e0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:52.061227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:52.062603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:52.076026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d4cc-5f6c-45ed-b180-117be8b48148 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:52.130440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:52.131293 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:52.131609 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:52.131886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] PATH_INFO: `/v3/users/f5e5d041aa764f61bb473d182b3b76d1` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:52.133048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e5d041aa764f61bb473d182b3b76d1)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:52.134948 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:52.137138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:13:52.182045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e5d041aa764f61bb473d182b3b76d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.182689 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e5d041aa764f61bb473d182b3b76d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.183290 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e5d041aa764f61bb473d182b3b76d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.191437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e5d041aa764f61bb473d182b3b76d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.205834 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-7e672e8f-999b-4b1a-a81a-7f274b80d91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e5d041aa764f61bb473d182b3b76d1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.218086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1372/2728] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:13:52 2022] DELETE /identity/v3/users/f5e5d041aa764f61bb473d182b3b76d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:52.387576 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:13:52.389030 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:52.405209 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017d7b-ad5d-4e94-98c4-80db1730b72d admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:13:52.461561 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:13:52.462399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:52.462680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:52.462954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] PATH_INFO: `/v3/projects/7261e5603bcc46eab23d939845e3a7b7` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:52.464129 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7261e5603bcc46eab23d939845e3a7b7)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:13:52.466023 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:13:52.510912 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7261e5603bcc46eab23d939845e3a7b7', 'request_id': 'req-0ac059cf-509f-482e-98b9-f86ecd7acc95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.517391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7261e5603bcc46eab23d939845e3a7b7', 'request_id': 'req-0ac059cf-509f-482e-98b9-f86ecd7acc95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.522827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7261e5603bcc46eab23d939845e3a7b7', 'request_id': 'req-0ac059cf-509f-482e-98b9-f86ecd7acc95'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.536268 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] The token cache is being invalidate because project 7261e5603bcc46eab23d939845e3a7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:13:52.536554 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.537149 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0ac059cf-509f-482e-98b9-f86ecd7acc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:13:52.538664 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1357/2729] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:13:52 2022] DELETE /identity/v3/projects/7261e5603bcc46eab23d939845e3a7b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:13:53.633226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:13:53.633734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:13:53.633835 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:13:53.651160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] MFA Rules not processed for user `ef9c2b94381c4affb9800c66a7434793`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:13:53.652458 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:13:53.711288 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1373/2730] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:13:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:02.533361 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:03.704668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:28.353264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:28.353774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:28.353888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:28.372019 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] MFA Rules not processed for user `2fef8e733a7d41d59fe3e86936e1a2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:14:28.373260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:28.430052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1358/2731] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:38.422419 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=25 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:49.629180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:49.630583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:49.694137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e6770-cf46-4fc1-b94c-e5259b6415b1 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:49.698788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:49.699707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:49.699990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:49.700259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] PATH_INFO: `/v3/users/ef9c2b94381c4affb9800c66a7434793` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:49.701423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9c2b94381c4affb9800c66a7434793)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:49.703352 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:49.748298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9c2b94381c4affb9800c66a7434793'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:49.748993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9c2b94381c4affb9800c66a7434793'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:49.749601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9c2b94381c4affb9800c66a7434793'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:49.756750 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9c2b94381c4affb9800c66a7434793'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:49.768307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-62a7c530-5cc1-4488-b3f7-0363c0fa4cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9c2b94381c4affb9800c66a7434793'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:49.780196 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1374/2732] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:14:49 2022] DELETE /identity/v3/users/ef9c2b94381c4affb9800c66a7434793 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:14:49.957075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:49.980922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ef4d6-1c82-4c1c-92e8-4462dc8a8f92 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.039045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.039935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.040226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.040500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] PATH_INFO: `/v3/projects/5dc8fc57096e43c4838e8674652ea662` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.041881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc8fc57096e43c4838e8674652ea662)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.044013 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.092430 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc8fc57096e43c4838e8674652ea662', 'request_id': 'req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:50.099210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc8fc57096e43c4838e8674652ea662', 'request_id': 'req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:50.105036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc8fc57096e43c4838e8674652ea662', 'request_id': 'req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:50.118155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] The token cache is being invalidate because project 5dc8fc57096e43c4838e8674652ea662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:14:50.118444 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:50.119116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-0af08cd2-bdbe-4e4b-adbb-ef567c059dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:50.120753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1359/2733] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:14:49 2022] DELETE /identity/v3/projects/5dc8fc57096e43c4838e8674652ea662 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:14:50.125703 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.126006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.126289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.144989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:14:50.146110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:50.210333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1375/2734] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:50.217934 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.218228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.218730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.241819 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:14:50.243026 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:50.251117 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1360/2735] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:50.255966 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.267756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c0a6-8bb4-4041-9f8c-a3397a593082 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.272884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.273548 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.273832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.274112 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.274872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:14:50.275182 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.276993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.289547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1376/2736] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:14:50.293979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.303731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6332-8a71-4b08-b7d3-ea424d2393e6 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.308399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.309097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.309378 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.309653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.310337 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.312256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.339423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1361/2737] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:14:50 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:14:50.344017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.355078 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078dc4a-1299-43e9-902f-4f316593029a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.359048 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:50.416707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.417283 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.417565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.417846 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.418553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.420642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.444764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1377/2738] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:14:50 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:14:50.449197 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.460331 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d0491-1a65-42a5-9156-4a613dd66d80 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.465091 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.465764 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.466052 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.466328 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.467063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.468708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.483708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1362/2739] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:14:50.485202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.495870 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a567-a49c-4061-b467-e471c2255dfc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.500776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.501457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.501765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.502044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.502815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.504658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad6111-a246-480b-adbe-6a215bc01ca5 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.519136 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1378/2740] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:14:50.520452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.530883 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32544d3b-5a32-4e7c-a507-631e10df37c2 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.536443 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.537334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.537614 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.537889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] PATH_INFO: `/v3/projects/3cb1ca5f9d4c46f198971623a3de0f41/users/8ab0c893771b437c86fc14d0d9e4ede6/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.554152 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb1ca5f9d4c46f198971623a3de0f41, user_id=8ab0c893771b437c86fc14d0d9e4ede6, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.556951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.576265 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1363/2741] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:14:50 2022] PUT /identity/v3/projects/3cb1ca5f9d4c46f198971623a3de0f41/users/8ab0c893771b437c86fc14d0d9e4ede6/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:14:50.586990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.587392 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.587770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.617711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] MFA Rules not processed for user `8ab0c893771b437c86fc14d0d9e4ede6`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:14:50.618920 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:50.684634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1379/2742] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:14:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:50.696071 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:50.697737 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:50.730487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:50.757908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026580-2543-4ca4-b69f-941cfca7201e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:50.761524 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:50.762189 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:50.762474 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:50.762746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:50.771531 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:50.772958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66547-75f6-44e1-93c0-ac5b81366cb0 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:50.781645 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1364/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:14:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:14:57.767485 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:57.829990 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6939d7-c101-4399-a06d-62d1ee336960 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:57.835152 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:57.836117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:57.836403 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:57.836680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] PATH_INFO: `/v3/users/8ab0c893771b437c86fc14d0d9e4ede6` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:57.837866 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab0c893771b437c86fc14d0d9e4ede6)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:57.839817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:57.855797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:14:57.888738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab0c893771b437c86fc14d0d9e4ede6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:57.889399 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab0c893771b437c86fc14d0d9e4ede6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:57.890014 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab0c893771b437c86fc14d0d9e4ede6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:57.898429 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab0c893771b437c86fc14d0d9e4ede6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:57.910345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab0c893771b437c86fc14d0d9e4ede6'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:57.922361 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1380/2744] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:14:57 2022] DELETE /identity/v3/users/8ab0c893771b437c86fc14d0d9e4ede6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:14:57.927449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:57.928039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:57.928039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:57.946105 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:14:57.947303 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:58.005335 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1365/2745] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:14:58.015244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:58.016754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:58.074159 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca28a19-2c9a-4523-aefe-50bf48ecf41b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:58.077759 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:58.078394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:58.078678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:58.078959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:58.088470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:58.089917 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970a460-c5a7-4e44-aa2d-3c3b882db8de service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:58.099849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1381/2746] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:14:58.363637 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:14:58.365096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:14:58.378946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a4646-e89b-4edb-bd7f-9d77c3e1e549 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:14:58.386316 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:14:58.387186 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:14:58.387592 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:14:58.387805 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] PATH_INFO: `/v3/projects/3cb1ca5f9d4c46f198971623a3de0f41` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:14:58.389008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb1ca5f9d4c46f198971623a3de0f41)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:14:58.390882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:14:58.436864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb1ca5f9d4c46f198971623a3de0f41', 'request_id': 'req-85e9ae12-67d0-47b5-8238-f31e085cd890'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:58.443364 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb1ca5f9d4c46f198971623a3de0f41', 'request_id': 'req-85e9ae12-67d0-47b5-8238-f31e085cd890'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:58.449781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb1ca5f9d4c46f198971623a3de0f41', 'request_id': 'req-85e9ae12-67d0-47b5-8238-f31e085cd890'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:58.461983 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] The token cache is being invalidate because project 3cb1ca5f9d4c46f198971623a3de0f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:14:58.462270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:58.462885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:14:58.464468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1366/2747] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:14:58 2022] DELETE /identity/v3/projects/3cb1ca5f9d4c46f198971623a3de0f41 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:15:08.095109 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:15:08.458407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:15:35.325231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:15:35.325754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:15:35.325754 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:15:35.342826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] MFA Rules not processed for user `2fef8e733a7d41d59fe3e86936e1a2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:15:35.344080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:15:35.398006 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1382/2748] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:15:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:15:42.893892 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:15:42.895410 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:15:42.955425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9ae12-67d0-47b5-8238-f31e085cd890 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:15:42.959190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:15:42.959868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:15:42.960154 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:15:42.960432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:15:42.962839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:15:43.034262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:15:43.035725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:15:43.046632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1367/2749] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:15:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:15:44.221115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:15:44.222500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:15:44.235046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a9649-9866-4aad-8212-778ff7764d3d None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:15:44.238540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:15:44.239167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:15:44.239450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:15:44.239770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:15:44.241466 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:15:44.254306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:15:44.255760 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:15:44.266491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1383/2750] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:15:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:15:53.041771 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=54 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:15:54.261734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=31 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:37.422084 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:37.424175 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:37.441276 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd33f-9aa2-45de-aad5-8143c61b24ca service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:37.447612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:37.448822 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:37.449080 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:37.450003 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:37.451848 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:37.466784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:37.468487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:37.484478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1368/2751] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:16:45.343707 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:45.345232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:45.409227 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547f71-f7fe-4037-ae70-2535dc33ec46 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:45.413815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:45.414702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.414989 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.415267 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] PATH_INFO: `/v3/users/2fef8e733a7d41d59fe3e86936e1a2fe` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.416479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fef8e733a7d41d59fe3e86936e1a2fe)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:45.418398 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:45.463363 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fef8e733a7d41d59fe3e86936e1a2fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.464046 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fef8e733a7d41d59fe3e86936e1a2fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.464661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fef8e733a7d41d59fe3e86936e1a2fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.471443 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fef8e733a7d41d59fe3e86936e1a2fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.483575 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-e3c7a0be-c5b7-4387-a21e-c3e743d967d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fef8e733a7d41d59fe3e86936e1a2fe'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.495207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1384/2752] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:16:45 2022] DELETE /identity/v3/users/2fef8e733a7d41d59fe3e86936e1a2fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:45.664579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:45.676153 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e26e5-2d9d-4234-89b7-cf4c55b72be0 service nova] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:45.733842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:45.734682 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.734962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.735233 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] PATH_INFO: `/v3/projects/5d45246ffd7c46838d124feb1663c52d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.736436 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d45246ffd7c46838d124feb1663c52d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:45.738818 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:45.783340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d45246ffd7c46838d124feb1663c52d', 'request_id': 'req-56d881c4-90bb-4269-bc7e-5405c8541347'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.789467 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d45246ffd7c46838d124feb1663c52d', 'request_id': 'req-56d881c4-90bb-4269-bc7e-5405c8541347'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.794918 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d45246ffd7c46838d124feb1663c52d', 'request_id': 'req-56d881c4-90bb-4269-bc7e-5405c8541347'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.807039 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] The token cache is being invalidate because project 5d45246ffd7c46838d124feb1663c52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:16:45.807320 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.807960 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56d881c4-90bb-4269-bc7e-5405c8541347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:45.809459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1369/2753] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:16:45 2022] DELETE /identity/v3/projects/5d45246ffd7c46838d124feb1663c52d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:45.814497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.814788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.815065 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.833369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:45.834562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:45.891440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1385/2754] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:45.898924 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.899214 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.899491 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.917138 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:45.918256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:45.926803 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1370/2755] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:45.930679 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:45.940244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80133c5-fdd8-4642-afc1-cdd5a794ceec None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:45.945455 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:45.946104 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.946388 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.946666 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.947382 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:16:45.947730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:45.949587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:45.960856 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1386/2756] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:16:45.964881 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:45.974025 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565090f1-65d5-403a-9b25-ee89e01b3a0a None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:45.978582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:45.979211 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:45.979543 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:45.979823 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:45.980509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:45.982392 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.008482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1371/2757] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:16:45 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:16:46.012589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:46.023007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc55b6-b78d-4cb1-bfb5-781eda027237 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:46.026677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:46.082601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:46.083273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.083596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.083889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.084566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:46.086479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.106199 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1387/2758] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:16:46 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:16:46.110226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:46.121289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484ec50-2d51-4403-beee-1731127fe146 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:46.126048 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:46.126693 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.126973 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.127246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.128004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:46.129605 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.139986 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1372/2759] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:16:46.143684 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:46.153482 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9292d1-42a7-44d1-a548-ea7a94951782 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:46.158117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:46.158763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.159044 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.159319 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.160572 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:46.162178 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67925-a68e-427c-889e-8b7b2fa6406b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.172520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1388/2760] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:16:46.176893 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:46.186584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353bc4-1f51-4550-93a8-c798b632fd65 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:46.191081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:46.191958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.192240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.192510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] PATH_INFO: `/v3/projects/d213d5f209f948abbe7e19f1e132fbad/users/3a235f73220b4f86b741d25b8c32222e/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.207908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d213d5f209f948abbe7e19f1e132fbad, user_id=3a235f73220b4f86b741d25b8c32222e, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:46.210636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.225353 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1373/2761] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:16:46 2022] PUT /identity/v3/projects/d213d5f209f948abbe7e19f1e132fbad/users/3a235f73220b4f86b741d25b8c32222e/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:46.234928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.235220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.235520 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.263011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] MFA Rules not processed for user `3a235f73220b4f86b741d25b8c32222e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:46.264262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:46.326007 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1389/2762] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:46.336903 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:46.338558 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:46.353287 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:46.414201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd32b-8d19-406e-a91c-097d671d0bfe admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:46.419796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:46.420470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:46.420757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:46.421038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:46.428821 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:46.430340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ee117-866d-4f66-a432-6fa67f8f4768 service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:46.439050 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1374/2763] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:16:49.080015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.137967 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aaa0c-fbd7-4e91-be34-8e44b14dd57e None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:49.142508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:49.143359 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.143664 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.143937 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] PATH_INFO: `/v3/users/3a235f73220b4f86b741d25b8c32222e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.145108 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a235f73220b4f86b741d25b8c32222e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:49.147012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:49.163532 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:49.192020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a235f73220b4f86b741d25b8c32222e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.192678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a235f73220b4f86b741d25b8c32222e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.193282 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a235f73220b4f86b741d25b8c32222e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.200936 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a235f73220b4f86b741d25b8c32222e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.214386 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a235f73220b4f86b741d25b8c32222e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.226875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1390/2764] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:16:49 2022] DELETE /identity/v3/users/3a235f73220b4f86b741d25b8c32222e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:49.231319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.231753 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.231935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.248670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:49.249874 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:49.308868 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1375/2765] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:49.318303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.320273 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:49.376541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634673-4010-498a-b3d2-e87b9985117a admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:49.380154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:49.380788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.381072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.381350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.391025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:49.392499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50982bc6-2861-4d38-a530-81be5b451172 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:49.401764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1391/2766] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:16:49.666376 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.667858 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:49.682127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a002-72ef-40e4-89d7-7984bcce4e95 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:49.686970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:49.687859 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.688148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.688413 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] PATH_INFO: `/v3/projects/d213d5f209f948abbe7e19f1e132fbad` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.689595 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d213d5f209f948abbe7e19f1e132fbad)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:49.691623 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:49.738249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd213d5f209f948abbe7e19f1e132fbad', 'request_id': 'req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.744259 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd213d5f209f948abbe7e19f1e132fbad', 'request_id': 'req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.750298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd213d5f209f948abbe7e19f1e132fbad', 'request_id': 'req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.762406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] The token cache is being invalidate because project d213d5f209f948abbe7e19f1e132fbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:16:49.762691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.763321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e00609cc-5ecb-46f3-b9dd-3c97fe9e9fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:16:49.764894 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1376/2767] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:16:49 2022] DELETE /identity/v3/projects/d213d5f209f948abbe7e19f1e132fbad => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:49.769836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.770126 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.770402 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.787898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:49.789137 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:49.846534 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1392/2768] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:49.856114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.856404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.856684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.876679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:49.877889 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:49.886352 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1377/2769] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:16:49.890409 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.900565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1952-786f-4565-8e1e-d10739a2012a None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:49.905099 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:49.905739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.906017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.906289 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.907001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:16:49.907302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:49.908968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:49.920075 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1393/2770] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:16:49.924137 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.933358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e3a30-ce6d-4f7b-b49a-7fbd16b03f8f None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:49.937919 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:49.938553 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:49.938838 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:49.939116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:49.939851 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:49.941766 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:49.955257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:49.968172 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1378/2771] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:16:49.972138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:49.981805 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ba01b-5325-4450-88a6-7c7338ef9387 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.001478 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:50.038369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.039026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.039318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.039635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.040328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.042241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.062303 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1394/2772] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:16:49 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:16:50.066326 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.077469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b539d4-21b8-45a5-8be4-6484bbc4a68f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.082038 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.082679 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.082958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.083234 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.083984 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.085551 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.095740 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1379/2773] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:16:50.099243 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.108888 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3a07-66de-49d9-acf3-274eba79767f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.113379 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.114011 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.114292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.114566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.115275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.119244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeed11-9543-410d-891e-4d1efbad1121 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.129169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1395/2774] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:16:50.133877 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.143692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989670-caea-4339-aad5-33ba3d38b7a8 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.148277 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.149192 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.149482 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.149759 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] PATH_INFO: `/v3/projects/9bfe4a3d35534f72a4bcb99b46861d0d/users/f40d7670656f4e6790531dc6f107176a/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.163839 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfe4a3d35534f72a4bcb99b46861d0d, user_id=f40d7670656f4e6790531dc6f107176a, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.166486 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.178683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1380/2775] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:16:50 2022] PUT /identity/v3/projects/9bfe4a3d35534f72a4bcb99b46861d0d/users/f40d7670656f4e6790531dc6f107176a/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:50.189163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.189456 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.189844 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.217310 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] MFA Rules not processed for user `f40d7670656f4e6790531dc6f107176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:50.218507 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:50.284131 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1396/2776] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:50.288726 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.349043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c117ec-b7f6-45dc-a2b1-8daf4c938e81 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.353708 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.354289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.354573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.354852 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.355549 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.357469 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.383064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1381/2777] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:16:50 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:16:50.387167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.397639 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783e37c-5b00-42d4-b476-be268de281bc None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.454645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.455304 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.455614 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.457959 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.458659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.460645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.484236 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1397/2778] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:16:50 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:16:50.488243 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.499114 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063038a2-ae18-40bf-9a6c-301061f22c47 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.503677 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.504322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.504599 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.504871 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.505588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.507156 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.517832 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1382/2779] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:16:50.521930 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.531868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548f6de-b137-420b-9ef5-643fe2efd85e admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.536410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.537299 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.537579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.537850 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] PATH_INFO: `/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd/users/94e25b3d18e24565828c8fe454ea7608/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.552770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0f12b6534b437e962ccc5b1f2b08cd, user_id=94e25b3d18e24565828c8fe454ea7608, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.556171 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.564642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:50.571061 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1398/2780] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:16:50 2022] PUT /identity/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd/users/94e25b3d18e24565828c8fe454ea7608/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:16:50.575478 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.585427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1b9e6-e337-4f08-b8d0-336fb5f18f88 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.640179 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.640829 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.641111 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.641385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.642101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.643698 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d8833-b70b-4b0e-a3be-7e7088394d9e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.653445 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1383/2781] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:16:50.657442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.668537 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5026de4-1de9-4bd1-b0cc-5aeb7f063db8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.673222 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.674113 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.674394 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.674667 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] PATH_INFO: `/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd/users/94e25b3d18e24565828c8fe454ea7608/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.676656 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0f12b6534b437e962ccc5b1f2b08cd, user_id=94e25b3d18e24565828c8fe454ea7608, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.679987 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.692025 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1399/2782] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:16:50 2022] PUT /identity/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd/users/94e25b3d18e24565828c8fe454ea7608/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:16:50.702714 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.703004 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.703283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.729505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] MFA Rules not processed for user `94e25b3d18e24565828c8fe454ea7608`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:16:50.730712 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:50.747922 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:16:50.799094 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1384/2783] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:16:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:16:50.810030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.811770 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:16:50.869348 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94c2a-86be-4290-9426-2e312e4bdcda admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.872958 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.873589 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.873872 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.874151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:50.883017 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:50.884481 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:50.893765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1400/2784] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:16:50.962237 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:16:50.972017 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63effbb6-8dfc-4bd9-9362-3720cbd644c1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:16:50.975562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:16:50.976734 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:16:50.977011 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:16:50.977280 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:16:51.033854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:16:51.035283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca7f38-c7cc-446f-8888-b7edf4f4336a service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:16:51.044725 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1385/2785] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:16:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:00.889579 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:01.040836 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=49 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:29.200643 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:29.264802 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339be21c-db6f-4898-bc33-dda7b20a463d service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:29.269312 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:29.270165 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:29.270444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:29.270717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] PATH_INFO: `/v3/users/f40d7670656f4e6790531dc6f107176a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:29.271928 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40d7670656f4e6790531dc6f107176a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:29.273832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:29.318325 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40d7670656f4e6790531dc6f107176a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.318968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40d7670656f4e6790531dc6f107176a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.319598 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40d7670656f4e6790531dc6f107176a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.326714 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40d7670656f4e6790531dc6f107176a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.338153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40d7670656f4e6790531dc6f107176a'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.350032 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1401/2786] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:29 2022] DELETE /identity/v3/users/f40d7670656f4e6790531dc6f107176a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:29.354459 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:29.354947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:29.355082 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:29.372499 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:29.373707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:29.430427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1386/2787] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:29.440503 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:29.441902 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:29.496811 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218922a-ff83-4a57-8988-38eeb97b898b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:29.501033 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:29.501674 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:29.501941 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:29.502220 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:29.510980 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:29.512438 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:29.521678 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1402/2788] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:29.780796 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:29.782314 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:29.797065 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba7e8-f5f5-48a7-9645-6e3ce4f137bb None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:29.802864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:29.803925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:29.804063 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:29.804375 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] PATH_INFO: `/v3/projects/9bfe4a3d35534f72a4bcb99b46861d0d` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:29.805628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfe4a3d35534f72a4bcb99b46861d0d)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:29.807529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:29.854083 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfe4a3d35534f72a4bcb99b46861d0d', 'request_id': 'req-ff793edb-dd6e-4e47-9eab-992962a3b079'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.860163 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfe4a3d35534f72a4bcb99b46861d0d', 'request_id': 'req-ff793edb-dd6e-4e47-9eab-992962a3b079'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.865809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfe4a3d35534f72a4bcb99b46861d0d', 'request_id': 'req-ff793edb-dd6e-4e47-9eab-992962a3b079'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.878307 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] The token cache is being invalidate because project 9bfe4a3d35534f72a4bcb99b46861d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:29.878590 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.879226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:29.880780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1387/2789] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:29 2022] DELETE /identity/v3/projects/9bfe4a3d35534f72a4bcb99b46861d0d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:29.884806 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:29.895372 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230542-0725-4411-ad47-b60087526a94 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:29.913008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:29.952250 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:29.953127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:29.953395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:29.953672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] PATH_INFO: `/v3/users/94e25b3d18e24565828c8fe454ea7608` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:29.954840 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e25b3d18e24565828c8fe454ea7608)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:29.956782 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.000256 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e25b3d18e24565828c8fe454ea7608'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.000897 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e25b3d18e24565828c8fe454ea7608'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.001501 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e25b3d18e24565828c8fe454ea7608'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.008570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e25b3d18e24565828c8fe454ea7608'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.021053 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-d1033765-307a-4c57-842f-1f98745fd4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e25b3d18e24565828c8fe454ea7608'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.032886 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1403/2790] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:29 2022] DELETE /identity/v3/users/94e25b3d18e24565828c8fe454ea7608 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:30.302799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.304308 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:30.318014 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff793edb-dd6e-4e47-9eab-992962a3b079 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.375485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.376407 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.376636 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.376908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] PATH_INFO: `/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.378064 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0f12b6534b437e962ccc5b1f2b08cd)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.379979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.409535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:30.427264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0f12b6534b437e962ccc5b1f2b08cd', 'request_id': 'req-e01972e2-569d-4587-b8f0-6d86863c0edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.433190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0f12b6534b437e962ccc5b1f2b08cd', 'request_id': 'req-e01972e2-569d-4587-b8f0-6d86863c0edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.438573 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0f12b6534b437e962ccc5b1f2b08cd', 'request_id': 'req-e01972e2-569d-4587-b8f0-6d86863c0edc'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.450274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] The token cache is being invalidate because project 1e0f12b6534b437e962ccc5b1f2b08cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:30.450565 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.451458 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-e01972e2-569d-4587-b8f0-6d86863c0edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:30.453045 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1388/2791] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:30 2022] DELETE /identity/v3/projects/1e0f12b6534b437e962ccc5b1f2b08cd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:30.457934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.458448 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.458566 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.476121 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:30.477296 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:30.540140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1404/2792] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:30.548662 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.549070 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.549358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.567121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:30.568354 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:30.576552 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1389/2793] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:30.580558 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.590093 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1934-b1dc-4a87-8548-db3e7dc05f41 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.595313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.595998 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.596279 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.596550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.597264 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79994) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:30.597567 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.599149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.611150 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1405/2794] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 06:17:30.615285 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.624452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1a0c9-f1e2-41ed-a063-d3deaba8705e None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.629146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.629738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.630000 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.630274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.630951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.632870 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.657856 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1390/2795] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:30.661808 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.672626 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30884050-cbf3-42c7-b5e3-f2a4d0322db9 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.697557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:30.728718 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.729370 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.729652 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.729929 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.730611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.733115 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.754110 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1406/2796] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:30.757992 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.768151 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f3466-375a-41ab-ab17-91a8b4fe4278 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.772944 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.773601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.773866 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.774147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.774861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.776475 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.788612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1391/2797] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:17:30.794368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.806854 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd7d1-4685-4049-ab38-47f071707013 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.812541 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.813207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.813719 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.814047 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.814877 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.817368 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb330b7-9b48-4a48-bd9a-bc2d6e4a5bea admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.828654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1407/2798] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:30.832754 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:30.843256 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e18f-4ab4-4aff-ab17-b4eee3046017 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:30.847935 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:30.848804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.849086 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.849363 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] PATH_INFO: `/v3/projects/6331198013a24f5bab4967d9ce359c5a/users/5b4bbf55ec3f4c2e92d035a77f6c7e8c/roles/b82d7152a4f64644aafded785d073762` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.865878 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6331198013a24f5bab4967d9ce359c5a, user_id=5b4bbf55ec3f4c2e92d035a77f6c7e8c, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:30.868588 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:30.882640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1392/2799] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:30 2022] PUT /identity/v3/projects/6331198013a24f5bab4967d9ce359c5a/users/5b4bbf55ec3f4c2e92d035a77f6c7e8c/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:30.893442 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:30.893734 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:30.894020 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:30.920172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] MFA Rules not processed for user `5b4bbf55ec3f4c2e92d035a77f6c7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:30.921364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:30.982944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1408/2800] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:30.987254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.047085 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062395a-8be5-49e6-a62b-ba03e10f07ed admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.051680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.052324 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.052607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.052887 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] PATH_INFO: `/v3/projects` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.053607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.055485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.081021 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1393/2801] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:30 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:31.084986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.096791 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a99da7-b4a5-421f-9010-f434afcfd884 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.155603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.156206 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.156491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.156769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] PATH_INFO: `/v3/users` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.157518 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.159488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.179246 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1409/2802] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:31 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:31.183215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.194201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef926093-0f16-4079-be2b-b14dd3c31512 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.198770 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.199409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.199719 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.199993 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.201600 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.203173 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.214370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1394/2803] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:31.218474 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.228661 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d456ee-61f7-4677-a13a-646a4897aace admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.233351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.234224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.234508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.234788 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] PATH_INFO: `/v3/projects/fe6fc2b4c30149e69478319b61e86d10/users/8c1f8d723566484fa6ed24a2d950145a/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.249645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6fc2b4c30149e69478319b61e86d10, user_id=8c1f8d723566484fa6ed24a2d950145a, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.252396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.265360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1410/2804] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:31 2022] PUT /identity/v3/projects/fe6fc2b4c30149e69478319b61e86d10/users/8c1f8d723566484fa6ed24a2d950145a/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:17:31.269289 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.279240 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae49fe-00b5-484b-a7fd-5716d080fa0a admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.298978 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:31.336575 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.337221 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.337502 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.337773 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.338480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.340101 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9180d-40ad-477c-bcd9-5d5ddb509ae5 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.349499 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1395/2805] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:31.353505 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.359192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:31.365681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8364-bb09-485c-8577-3d8a553896b0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.370635 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.371628 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.372489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.372763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] PATH_INFO: `/v3/projects/fe6fc2b4c30149e69478319b61e86d10/users/8c1f8d723566484fa6ed24a2d950145a/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.374813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6fc2b4c30149e69478319b61e86d10, user_id=8c1f8d723566484fa6ed24a2d950145a, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.377509 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.387385 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1411/2806] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:31 2022] PUT /identity/v3/projects/fe6fc2b4c30149e69478319b61e86d10/users/8c1f8d723566484fa6ed24a2d950145a/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:31.398733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.399215 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.399332 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.425404 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] MFA Rules not processed for user `8c1f8d723566484fa6ed24a2d950145a`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:31.426544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:31.494141 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1396/2807] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:31.506500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.508251 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:31.564644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17654fe-6a69-4d09-b0a4-f97f3e078851 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.568259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.568885 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.569168 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.569444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.578561 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.580039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.589262 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1412/2808] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:31.881170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.890274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f97-b1be-4058-b6c8-4089a45afd20 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.894784 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c1f8d723566484fa6ed24a2d950145a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe6fc2b4c30149e69478319b61e86d10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.895433 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.895755 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.896047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.896783 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:31.897096 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.898691 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.910468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1397/2809] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:17:31.914377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.923852 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896b60-5e94-491c-a1d6-c462c6803b75 service cinder] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:31.928421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c1f8d723566484fa6ed24a2d950145a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe6fc2b4c30149e69478319b61e86d10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:31.929052 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:31.929335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:31.929611 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:31.930295 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:31.932226 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:31.958235 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1413/2810] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:31 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:31.962249 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:31.972602 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f9b3a-1c0b-46be-9f78-5ec044607f23 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:32.029370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c1f8d723566484fa6ed24a2d950145a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe6fc2b4c30149e69478319b61e86d10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:32.030032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:32.030317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:32.030596 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:32.031321 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:32.031670 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:32.033269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:32.045400 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1398/2811] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:17:32.080328 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:32.090335 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52799-ff58-4912-a8a7-fbf361e7c603 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:32.095390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c1f8d723566484fa6ed24a2d950145a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe6fc2b4c30149e69478319b61e86d10', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:32.096259 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:32.096550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:32.096829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] PATH_INFO: `/v3/projects/a3b0d27453bf4ff18a52de2050b924fa` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:32.097992 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3b0d27453bf4ff18a52de2050b924fa)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:32.099913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:32.145406 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b0d27453bf4ff18a52de2050b924fa', 'request_id': 'req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.152384 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b0d27453bf4ff18a52de2050b924fa', 'request_id': 'req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.158557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b0d27453bf4ff18a52de2050b924fa', 'request_id': 'req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.169836 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] The token cache is being invalidate because project a3b0d27453bf4ff18a52de2050b924fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:32.170119 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.170764 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-72a2ed18-b65a-4d7d-98f0-2a55b6268af1 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.172330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1414/2812] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:32 2022] DELETE /identity/v3/projects/a3b0d27453bf4ff18a52de2050b924fa => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:32.355257 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:32.356997 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:32.386509 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=100 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:32.420506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cdfff-bbaa-461c-b942-8bccba72f607 tempest-VolumeQuotaClassesTest-1059323768 tempest-VolumeQuotaClassesTest-1059323768-project-admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:32.474479 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:32.475387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:32.475644 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:32.475921 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] PATH_INFO: `/v3/users/5b4bbf55ec3f4c2e92d035a77f6c7e8c` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:32.477212 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4bbf55ec3f4c2e92d035a77f6c7e8c)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:32.479127 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:32.522976 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4bbf55ec3f4c2e92d035a77f6c7e8c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.535325 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4bbf55ec3f4c2e92d035a77f6c7e8c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.536006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4bbf55ec3f4c2e92d035a77f6c7e8c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.536624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4bbf55ec3f4c2e92d035a77f6c7e8c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.543520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4bbf55ec3f4c2e92d035a77f6c7e8c'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:32.555546 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1399/2813] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:32 2022] DELETE /identity/v3/users/5b4bbf55ec3f4c2e92d035a77f6c7e8c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:32.559962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:32.560433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:32.560543 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:32.578187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:32.579356 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:32.624523 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:32.638553 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1415/2814] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:32.648397 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:32.649792 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:32.706946 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13cdd-c915-4658-b445-9c20c9745f06 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:32.710562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:32.711200 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:32.711485 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:32.711795 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:32.718702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:32.721115 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:32.722931 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:32.734144 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1400/2815] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:33.001353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.002926 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:33.015810 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5fa13-c4ef-4a35-9830-cb53ee256b21 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.020645 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.021527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.021823 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.022202 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] PATH_INFO: `/v3/projects/6331198013a24f5bab4967d9ce359c5a` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.023377 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6331198013a24f5bab4967d9ce359c5a)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.025345 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.070488 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6331198013a24f5bab4967d9ce359c5a', 'request_id': 'req-9abb41db-f0f9-4286-9082-b76a6f91f6a0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.077519 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6331198013a24f5bab4967d9ce359c5a', 'request_id': 'req-9abb41db-f0f9-4286-9082-b76a6f91f6a0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.082887 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6331198013a24f5bab4967d9ce359c5a', 'request_id': 'req-9abb41db-f0f9-4286-9082-b76a6f91f6a0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.093975 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] The token cache is being invalidate because project 6331198013a24f5bab4967d9ce359c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:33.094261 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.094898 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.096454 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1416/2816] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:33 2022] DELETE /identity/v3/projects/6331198013a24f5bab4967d9ce359c5a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:33.100426 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.110447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74c89e-80bc-47b0-9aed-2af1e1f5df88 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.165544 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.166396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.166683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.166965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] PATH_INFO: `/v3/users/8c1f8d723566484fa6ed24a2d950145a` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.168147 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1f8d723566484fa6ed24a2d950145a)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.170557 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.216053 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1f8d723566484fa6ed24a2d950145a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.227842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1f8d723566484fa6ed24a2d950145a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.228520 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1f8d723566484fa6ed24a2d950145a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.229124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1f8d723566484fa6ed24a2d950145a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.236728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-f686489c-d336-4c24-ad95-294efd9f37b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1f8d723566484fa6ed24a2d950145a'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.249579 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1401/2817] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:33 2022] DELETE /identity/v3/users/8c1f8d723566484fa6ed24a2d950145a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:33.522101 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.523634 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:33.537499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb41db-f0f9-4286-9082-b76a6f91f6a0 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.594623 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.595479 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.595793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.596072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] PATH_INFO: `/v3/projects/fe6fc2b4c30149e69478319b61e86d10` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.597252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6fc2b4c30149e69478319b61e86d10)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.599156 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.643148 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6fc2b4c30149e69478319b61e86d10', 'request_id': 'req-8cc8c43e-5839-46be-bb9b-d422bbedb070'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.650231 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6fc2b4c30149e69478319b61e86d10', 'request_id': 'req-8cc8c43e-5839-46be-bb9b-d422bbedb070'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.656465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6fc2b4c30149e69478319b61e86d10', 'request_id': 'req-8cc8c43e-5839-46be-bb9b-d422bbedb070'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.667331 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] The token cache is being invalidate because project fe6fc2b4c30149e69478319b61e86d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:33.667648 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.668277 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-8cc8c43e-5839-46be-bb9b-d422bbedb070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:33.670414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1417/2818] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:33 2022] DELETE /identity/v3/projects/fe6fc2b4c30149e69478319b61e86d10 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:33.675254 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.675837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.675837 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.693720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:33.694956 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:33.752568 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1402/2819] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:33.760026 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.760318 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.760599 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.772730 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:33.780069 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:33.781879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:33.790149 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1418/2820] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:33.794290 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.804703 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522eaf-5b6c-4966-8f6c-c080eaf84f6d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.809296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.809942 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.810228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.810510 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.811236 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:33.811577 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.813164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.824393 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1403/2821] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:17:33.829337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.838962 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298414a-bf3c-4245-8159-396d5789a5d7 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.844177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.844809 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.845087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.845357 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.846041 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.847963 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.872253 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1419/2822] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:33 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:33.876283 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.881380 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:33.888136 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de95bd-da08-4ac0-8670-3192a8df14e6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.943468 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.944148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.944432 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.944730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.945533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.947448 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:33.969715 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1404/2823] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:33 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:33.971829 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:33.982001 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34e02-aad9-4438-8617-b2c80a15bfdb admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:33.986573 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:33.987218 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:33.987522 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:33.987815 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:33.988540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:33.990151 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.001450 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1420/2824] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:34.005269 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.015965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca123a-78a8-478c-b39b-c1e1f64fc917 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.020572 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.021227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.021516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.021797 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.022556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.024232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07011-c683-4ea3-84a4-c0c70639d480 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.035201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1405/2825] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:17:34.039080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.048814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf369-a6c1-4833-8eb8-32bd4b81ad68 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.053364 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.054224 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.054500 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.054776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] PATH_INFO: `/v3/projects/680677a6db1c4c019811a450a304a3a7/users/68f9039c0d3f45309581de570a405940/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.068743 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680677a6db1c4c019811a450a304a3a7, user_id=68f9039c0d3f45309581de570a405940, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.071433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.084892 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1421/2826] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:34 2022] PUT /identity/v3/projects/680677a6db1c4c019811a450a304a3a7/users/68f9039c0d3f45309581de570a405940/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:17:34.096624 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.096947 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.097232 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.123788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] MFA Rules not processed for user `68f9039c0d3f45309581de570a405940`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:34.124999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:34.188465 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1406/2827] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:34.192969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.254527 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226dd9a-a2e7-470c-95f4-1721a5400b27 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.259140 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.259814 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.260097 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.260373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.261063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.263601 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.287153 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1422/2828] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:34 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:34.291246 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.302201 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8739b86-011f-4662-bf91-c08eb943a88d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.356031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.356675 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.356955 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.357227 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.357901 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.359827 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.375346 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:34.381635 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1407/2829] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:34 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:34.385489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.396294 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb10ef-978b-4905-b457-0a17d5e17085 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.400863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.401517 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.401801 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.402082 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.402798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.404453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.414657 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1423/2830] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:34.418843 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.428782 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6189a-15fe-4627-82e9-88fe2699d06c admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.433389 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.434248 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.435043 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.435327 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] PATH_INFO: `/v3/projects/5727ac9e220149bb809adcd77e7e8923/users/214f8013a48c401c8a334cf53168b899/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.449688 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5727ac9e220149bb809adcd77e7e8923, user_id=214f8013a48c401c8a334cf53168b899, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.453270 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.471733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1408/2831] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:34 2022] PUT /identity/v3/projects/5727ac9e220149bb809adcd77e7e8923/users/214f8013a48c401c8a334cf53168b899/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:34.476009 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.486111 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0b97-3fe1-4903-bef8-08baa0f1e824 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.541677 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.542252 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.542529 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.542798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.543536 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.545687 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c042f-ba89-4b4d-aaf1-3f8e00887b21 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.554974 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1424/2832] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:17:34.559033 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.569761 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ac766-cc98-40b2-aa36-801a54da7c8f admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.574350 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.575210 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.575516 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.575809 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] PATH_INFO: `/v3/projects/5727ac9e220149bb809adcd77e7e8923/users/214f8013a48c401c8a334cf53168b899/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.578037 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5727ac9e220149bb809adcd77e7e8923, user_id=214f8013a48c401c8a334cf53168b899, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.580707 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.590607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1409/2833] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:34 2022] PUT /identity/v3/projects/5727ac9e220149bb809adcd77e7e8923/users/214f8013a48c401c8a334cf53168b899/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:34.600376 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.600881 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.600996 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.625234 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:34.628632 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] MFA Rules not processed for user `214f8013a48c401c8a334cf53168b899`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:34.631180 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:34.697919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1425/2834] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:17:34.709046 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.710793 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:34.767778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c39826-2c90-4b3d-ab0b-2d75d5cb7ec3 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.771434 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.772097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.772386 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.772666 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.781581 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.783008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.792500 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1410/2835] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:34.844258 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:34.845642 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:34.857923 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855e46-f3e4-471e-a967-b5a3e968ea10 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:34.861550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:34.862177 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:34.862497 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:34.862755 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:34.917660 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:34.919715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1db8c-df28-4581-87be-b2664b713551 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:34.928472 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1426/2836] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:38.144431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:38.205098 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b345a5-0488-4cfa-bbaa-72f334d2d106 service cinder] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:38.211032 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:38.212177 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:38.212574 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:38.212863 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] PATH_INFO: `/v3/users/68f9039c0d3f45309581de570a405940` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:38.214161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f9039c0d3f45309581de570a405940)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:38.216697 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:38.263203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f9039c0d3f45309581de570a405940'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.274802 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f9039c0d3f45309581de570a405940'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.275513 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f9039c0d3f45309581de570a405940'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.276146 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f9039c0d3f45309581de570a405940'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.279081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:38.284313 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f9039c0d3f45309581de570a405940'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.298704 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1411/2837] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:38 2022] DELETE /identity/v3/users/68f9039c0d3f45309581de570a405940 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:38.303170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:38.303653 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:38.303765 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:38.320232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:38.321421 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:38.378612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1427/2838] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:38.388480 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:38.389885 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:38.445711 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981e2cf-790b-41f9-bc81-dc500e0eefc0 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:38.449452 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:38.450075 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:38.451015 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:38.451296 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:38.460514 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:38.461925 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:38.471897 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1412/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:38.733668 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:38.735164 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:38.747538 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53feed8c-d2a2-4bd4-89a2-e43fc9c1785f None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:38.752016 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:38.752867 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:38.753147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:38.753424 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] PATH_INFO: `/v3/projects/680677a6db1c4c019811a450a304a3a7` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:38.754596 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680677a6db1c4c019811a450a304a3a7)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:38.756557 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:38.792404 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:38.805360 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680677a6db1c4c019811a450a304a3a7', 'request_id': 'req-a7897631-4584-46b3-84b3-7f9af0035197'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.813233 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680677a6db1c4c019811a450a304a3a7', 'request_id': 'req-a7897631-4584-46b3-84b3-7f9af0035197'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.818785 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680677a6db1c4c019811a450a304a3a7', 'request_id': 'req-a7897631-4584-46b3-84b3-7f9af0035197'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.830530 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] The token cache is being invalidate because project 680677a6db1c4c019811a450a304a3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:38.830813 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.831432 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.832997 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1428/2840] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:38 2022] DELETE /identity/v3/projects/680677a6db1c4c019811a450a304a3a7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:38.836945 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:38.846718 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1495-a90b-4eab-b6d6-2452bf678959 service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:38.904601 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:38.905470 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:38.905757 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:38.906031 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] PATH_INFO: `/v3/users/214f8013a48c401c8a334cf53168b899` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:38.907217 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214f8013a48c401c8a334cf53168b899)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:38.909169 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:38.956814 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214f8013a48c401c8a334cf53168b899'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.968423 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214f8013a48c401c8a334cf53168b899'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.969054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214f8013a48c401c8a334cf53168b899'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.969660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214f8013a48c401c8a334cf53168b899'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.976768 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-b8ce9074-2fec-4fcd-bb63-8910bd11cd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214f8013a48c401c8a334cf53168b899'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:38.988909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1413/2841] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:38 2022] DELETE /identity/v3/users/214f8013a48c401c8a334cf53168b899 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:39.262414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.263896 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:39.278763 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897631-4584-46b3-84b3-7f9af0035197 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.335396 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.336275 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.336563 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.336832 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] PATH_INFO: `/v3/projects/5727ac9e220149bb809adcd77e7e8923` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.338040 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5727ac9e220149bb809adcd77e7e8923)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.340029 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.384817 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5727ac9e220149bb809adcd77e7e8923', 'request_id': 'req-25036561-3dca-4a5a-8cce-aa3eb8412ec0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:39.391241 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5727ac9e220149bb809adcd77e7e8923', 'request_id': 'req-25036561-3dca-4a5a-8cce-aa3eb8412ec0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:39.396913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5727ac9e220149bb809adcd77e7e8923', 'request_id': 'req-25036561-3dca-4a5a-8cce-aa3eb8412ec0'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:39.408400 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] The token cache is being invalidate because project 5727ac9e220149bb809adcd77e7e8923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:39.408681 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:39.409302 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-25036561-3dca-4a5a-8cce-aa3eb8412ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:39.410798 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1429/2842] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:39 2022] DELETE /identity/v3/projects/5727ac9e220149bb809adcd77e7e8923 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:39.416730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.417198 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.417299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.430056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:39.436629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:39.438453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:39.495464 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1414/2843] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:39.503064 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.503349 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.503659 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.521179 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:39.522350 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:39.531281 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1430/2844] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:39.535226 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.546027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713bd87-8d32-4744-aad6-d7db1c7a2d1d None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.550628 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.551271 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.551584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.551869 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.552842 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:39.553162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.554778 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.566680 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1415/2845] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:17:39.570837 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.580298 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad573-d532-41f0-a481-5c095eb08cd8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.584874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.585502 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.585787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.586060 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.586773 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.588723 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.614839 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1431/2846] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:39.618799 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.628747 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930a09-c43e-4aaa-9770-ba76f1bf0376 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.685745 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.686405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.686689 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.686965 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.687683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.689585 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.709366 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1416/2847] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:39 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:39.713508 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.724086 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d328f-52bb-4622-8681-c01afd0fa53b admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.728594 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.729232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.729510 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.729786 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.730499 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.732724 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.742715 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1432/2848] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 06:17:39.746421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.756170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495433e-60b7-475a-aab2-522c5972a7b7 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.760804 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.761447 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.761729 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.762005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.762720 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.764330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aeaf2-432e-4dbf-956b-c2b7b32dffbf admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.774006 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1417/2849] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:39.777940 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.787993 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645447c-80fd-484d-9662-c58b5829ed80 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:39.792476 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:39.793322 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.793602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.793879 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] PATH_INFO: `/v3/projects/b117812f6a3a4c85896499d7284c9b0c/users/0cf4454347e648b085562958bb960af7/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.802207 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:39.810172 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b117812f6a3a4c85896499d7284c9b0c, user_id=0cf4454347e648b085562958bb960af7, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:39.813147 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:39.825757 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1433/2850] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:39 2022] PUT /identity/v3/projects/b117812f6a3a4c85896499d7284c9b0c/users/0cf4454347e648b085562958bb960af7/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:17:39.885686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:39.885882 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:39.886158 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:39.919427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] MFA Rules not processed for user `0cf4454347e648b085562958bb960af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:39.920686 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:39.982979 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1418/2851] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:39.993944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:39.995616 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.050451 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712691b-148f-4cd9-a902-2ae561a6980f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.054012 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e0e69820cb4c269c1d6043d70380f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.054633 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.054913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.055187 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.063447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.064863 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a8f99-4844-4bb4-aead-c4a40ab9d3b7 service cinder] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.073631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1434/2852] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:40.094406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:40.098613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:40.156629 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f4887-4493-4ce3-8e6f-c75b2c18b833 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.161081 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.161939 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.162222 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.162501 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] PATH_INFO: `/v3/users/0cf4454347e648b085562958bb960af7` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.163702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf4454347e648b085562958bb960af7)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.165606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.213042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf4454347e648b085562958bb960af7'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.225493 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf4454347e648b085562958bb960af7'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.226208 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf4454347e648b085562958bb960af7'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.226830 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf4454347e648b085562958bb960af7'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.234840 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf4454347e648b085562958bb960af7'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.248216 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1419/2853] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:17:40 2022] DELETE /identity/v3/users/0cf4454347e648b085562958bb960af7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:40.252767 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.253056 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.253333 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.271663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:40.273161 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.331597 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1435/2854] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:40.341274 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:40.342638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.398556 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5a220-1643-4805-a17e-948419b256a7 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.402176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.402806 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.403090 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.403406 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.412358 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.413717 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41451-0faf-49e2-b5e8-4409fc7aaf3e service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.423125 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1420/2855] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:40.681410 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:40.682889 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.696092 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b85a5a-fe51-42b6-b2de-a7bf9c027f05 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.700742 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.701602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.702155 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.702431 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] PATH_INFO: `/v3/projects/b117812f6a3a4c85896499d7284c9b0c` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.703729 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b117812f6a3a4c85896499d7284c9b0c)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.705658 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.752015 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b117812f6a3a4c85896499d7284c9b0c', 'request_id': 'req-c9c70198-4d1c-469b-a84e-626b6a07c665'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.758816 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b117812f6a3a4c85896499d7284c9b0c', 'request_id': 'req-c9c70198-4d1c-469b-a84e-626b6a07c665'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.764717 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b117812f6a3a4c85896499d7284c9b0c', 'request_id': 'req-c9c70198-4d1c-469b-a84e-626b6a07c665'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.775369 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] The token cache is being invalidate because project b117812f6a3a4c85896499d7284c9b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79994) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:17:40.775680 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.776306 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-c9c70198-4d1c-469b-a84e-626b6a07c665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:17:40.777843 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1436/2856] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:17:40 2022] DELETE /identity/v3/projects/b117812f6a3a4c85896499d7284c9b0c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:40.782672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.782990 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.783263 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.800808 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:40.801998 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.821533 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:40.862124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1421/2857] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:40.869583 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.869873 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.870154 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.889969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:40.891160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:40.900034 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1437/2858] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:40.905357 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:40.915183 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963c72-891d-41ae-8c20-b23f6cbc33c1 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.920305 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.920958 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.921250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.921505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.922245 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 06:17:40.922548 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.924223 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.940278 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1422/2859] 10.222.0.13 () {58 vars in 1152 bytes} [Wed Jun 22 06:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 06:17:40.944644 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:40.953935 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cad842-1461-4e11-836f-bd4f854dd175 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:40.958491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:40.959125 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:40.959422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:40.959705 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:40.960390 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:40.962268 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:40.965407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:40.989859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1438/2860] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:40 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:40.993888 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:41.003794 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ebb1-d4fa-4675-8e43-91870adda3ac admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:41.058056 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:41.058700 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.058982 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.059255 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.060076 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:41.061980 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:41.080975 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1423/2861] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:40 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:41.084946 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:41.095672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f44d2-fd91-4950-b0ac-5ab2a4d5501d admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:41.100373 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:41.101021 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.101307 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.101585 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.102309 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:41.104134 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:41.114603 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1439/2862] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:41.118394 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:41.128139 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22e4a-4c45-4394-b126-8a66dd717042 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:41.132738 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:41.133372 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.133653 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.133927 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] PATH_INFO: `/v3/roles` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.134665 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:41.136272 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd09bd6-fb21-49e4-a07e-0efee4f2685b admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:41.145909 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1424/2863] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:41.149722 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:41.159793 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a78078-541e-45a8-9711-008ab64fe9dc admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:41.164313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:41.165163 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.165440 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.165712 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] PATH_INFO: `/v3/projects/064014a25c0e4e0da3b289cb3ea802e0/users/e72d1f42979b44bf9b8bf5d33b09685e/roles/b82d7152a4f64644aafded785d073762` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.181483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064014a25c0e4e0da3b289cb3ea802e0, user_id=e72d1f42979b44bf9b8bf5d33b09685e, role_id=b82d7152a4f64644aafded785d073762)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:41.184118 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:41.196631 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1440/2864] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:41 2022] PUT /identity/v3/projects/064014a25c0e4e0da3b289cb3ea802e0/users/e72d1f42979b44bf9b8bf5d33b09685e/roles/b82d7152a4f64644aafded785d073762 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:17:41.201582 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803db4-7878-4236-90d5-0fa7af96ecb3 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.202230 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803db4-7878-4236-90d5-0fa7af96ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.202560 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803db4-7878-4236-90d5-0fa7af96ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.221962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-f5803db4-7878-4236-90d5-0fa7af96ecb3 None None] MFA Rules not processed for user `201066f4889b4d3489fddb5528338862`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:41.223170 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-f5803db4-7878-4236-90d5-0fa7af96ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:41.281505 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1425/2865] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:17:41.291550 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:41.293314 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:41.350663 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71558a8-091e-4975-9fc2-d46536bf9080 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:41.354305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:41.354934 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:41.355214 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:41.355489 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:41.364446 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:41.365875 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:41.375102 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1441/2866] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:17:44.994262 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:44.994739 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:44.994890 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.029124 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] MFA Rules not processed for user `e72d1f42979b44bf9b8bf5d33b09685e`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:45.031228 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:45.054190 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:45.113299 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1426/2867] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 06:17:45.115321 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.125562 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0158-2a98-43a9-b53c-0acdeb3a5fd8 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.130559 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.131213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.131613 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.131862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.132547 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.134433 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.163853 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1442/2868] 10.222.0.13 () {60 vars in 1152 bytes} [Wed Jun 22 06:17:45 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 06:17:45.167427 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.180322 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa5c0f-5438-40ee-88d6-f4c88bf2e5c0 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.255453 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.256164 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.256449 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.256728 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] PATH_INFO: `/v3/users` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.257431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.259374 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.292964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1427/2869] 10.222.0.13 () {60 vars in 1143 bytes} [Wed Jun 22 06:17:45 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 06:17:45.296630 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.307862 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b57292-87f5-475d-bf0e-a82e439d3db3 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.313355 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.314278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.314738 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.315167 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.316107 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.318342 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.334436 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1443/2870] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:45.339036 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.350529 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b393d31-ee31-4857-9877-9a8142715e62 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.355295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.356260 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.356610 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.356864 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] PATH_INFO: `/v3/projects/519e4c6c8b34485b9811ab28d01b1be3/users/57164119e34a433d91b0c594f2ec217e/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.374176 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=519e4c6c8b34485b9811ab28d01b1be3, user_id=57164119e34a433d91b0c594f2ec217e, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.377024 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.391431 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1428/2871] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:45 2022] PUT /identity/v3/projects/519e4c6c8b34485b9811ab28d01b1be3/users/57164119e34a433d91b0c594f2ec217e/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 06:17:45.395313 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.406204 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc2ac-d81f-4b7a-a079-8dffc1780574 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.461414 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.462070 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.462351 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.462621 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.463330 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.464944 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eb198-e3a3-433d-9b36-c030be7ca100 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.474358 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1444/2872] 10.222.0.13 () {58 vars in 1121 bytes} [Wed Jun 22 06:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 06:17:45.478639 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:45.488951 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ce06-1580-49ac-9e4f-d02480418cad admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:45.493542 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:45.494405 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] REQUEST_METHOD: `PUT` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:45.494692 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:45.494970 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] PATH_INFO: `/v3/projects/519e4c6c8b34485b9811ab28d01b1be3/users/57164119e34a433d91b0c594f2ec217e/roles/4cd2e68829054accb9aea2630b1fafb0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:45.496963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] RBAC: Authorizing `identity:create_grant(project_id=519e4c6c8b34485b9811ab28d01b1be3, user_id=57164119e34a433d91b0c594f2ec217e, role_id=4cd2e68829054accb9aea2630b1fafb0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:45.500168 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:45.510559 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1429/2873] 10.222.0.13 () {60 vars in 1482 bytes} [Wed Jun 22 06:17:45 2022] PUT /identity/v3/projects/519e4c6c8b34485b9811ab28d01b1be3/users/57164119e34a433d91b0c594f2ec217e/roles/4cd2e68829054accb9aea2630b1fafb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:17:50.007711 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfcd4-ab47-41ea-b24c-acaa420d0805 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:50.008201 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfcd4-ab47-41ea-b24c-acaa420d0805 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:50.008320 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfcd4-ab47-41ea-b24c-acaa420d0805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:50.036297 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-f9adfcd4-ab47-41ea-b24c-acaa420d0805 None None] MFA Rules not processed for user `57164119e34a433d91b0c594f2ec217e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:17:50.037513 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-f9adfcd4-ab47-41ea-b24c-acaa420d0805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:50.041868 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:50.118972 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1445/2874] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:17:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:17:50.136854 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:17:50.139654 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:17:50.214194 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d232d-e17e-428c-bff8-a4e9f971971e admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:17:50.226967 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:17:50.227742 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:17:50.228097 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:17:50.228440 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:17:50.240409 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:17:50.295999 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:17:50.297612 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:17:50.307140 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1430/2875] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:17:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:00.115919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=27 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:00.303340 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=23 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:07.497826 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] REQUEST_METHOD: `POST` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:07.498323 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:07.498545 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:07.516170 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.auth.core [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] MFA Rules not processed for user `e72d1f42979b44bf9b8bf5d33b09685e`. Rule list: `[]` (Enabled: `True`). {{(pid=79994) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:18:07.517353 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:07.524495 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1446/2876] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:18:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:18:07.827391 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:07.829425 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:07.885683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b074-39eb-4b8b-9bd2-c2a5082d880f service nova] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:07.889250 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:07.889876 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:07.890155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:07.891005 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:07.892733 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:07.902035 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:07.903435 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:07.911295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1431/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:08.345191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:08.346641 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:08.427391 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a2091-aabb-4365-9bcc-a6d4fdc6fad8 None None] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:08.432278 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:08.432913 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:08.433191 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:08.433460 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:08.435194 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:08.446787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:08.448395 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:08.458257 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1447/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:10.148584 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:10.158684 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189219-9739-4279-bf8f-2004c5f1a15b service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:10.162385 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:10.163027 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:10.163310 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:10.163896 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:10.166295 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:10.177343 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:10.179110 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:10.187731 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1432/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:18.454117 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=35 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:20.183713 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=32 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:21.579739 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:21.581292 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:21.597138 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a6cfb-ce95-4500-b3f0-308fb5d3965d service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:21.602549 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:21.603188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:21.603470 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:21.603776 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:21.605570 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:21.618453 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:21.620072 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:21.630769 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1448/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:23.814506 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:23.832964 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3651dc-3e66-4ed9-bf05-298c551df52e service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:23.836540 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:23.837159 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:23.837438 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:23.837706 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:23.867694 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:23.869116 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f301bdc-4bc2-45cd-90d8-f6c9d6dc5de7 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:23.878498 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1433/2881] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:18:31.626030 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:33.874403 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=20 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:18:59.123073 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:18:59.185792 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61cbe0-36b9-4d87-a610-3f9dc8dddc75 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:18:59.191444 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:18:59.192123 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:18:59.192407 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:18:59.192683 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:18:59.194491 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:18:59.233423 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:18:59.235076 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:18:59.245186 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1449/2882] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:18:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:19:09.240874 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=36 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:20:26.881663 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:20:26.882162 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:20:26.882264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:20:26.899571 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] MFA Rules not processed for user `e72d1f42979b44bf9b8bf5d33b09685e`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:20:26.900743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:20:26.908203 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1434/2883] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:20:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:20:27.219255 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:20:27.238291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc379-2587-45b2-b9d3-1b8ce57027e3 service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:20:27.241968 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:20:27.242602 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:20:27.242884 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:20:27.243160 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:20:27.244995 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:20:27.266910 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:20:27.268378 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:20:27.277080 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1450/2884] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:20:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:20:36.894954 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:20:37.272700 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=15 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:20:43.615535 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:20:43.625810 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bf1a-016b-464c-b9b3-de4a7a8e4236 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:20:43.629414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:20:43.630047 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:20:43.630334 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:20:43.630613 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:20:43.632421 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:20:43.664652 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:20:43.666074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91cbe9-375e-42ed-94cc-e6351807b333 service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:20:43.687319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1435/2885] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:20:44.859986 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:20:44.868544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77db1-41eb-4075-95d2-7b7cf5c52acb service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:20:44.872710 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:20:44.873337 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:20:44.873622 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:20:44.873894 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:20:44.875740 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:20:44.889157 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:20:44.890569 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:20:44.902465 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1451/2886] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:20:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:20:53.684730 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=18 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:20:54.897646 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:22:34.957161 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] REQUEST_METHOD: `POST` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:22:34.957678 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:22:34.957800 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:22:34.974396 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.auth.core [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] MFA Rules not processed for user `e72d1f42979b44bf9b8bf5d33b09685e`. Rule list: `[]` (Enabled: `True`). {{(pid=79995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 06:22:34.975606 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:22:34.982317 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1436/2887] 10.222.0.13 () {58 vars in 957 bytes} [Wed Jun 22 06:22:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 06:22:38.272758 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:22:38.289697 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce716bc-0cc2-4431-8b5e-23fde67fa0f4 service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:22:38.299437 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '217be31925ad4d859522dce86af2ca45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:22:38.300192 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:22:38.300427 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:22:38.300708 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:22:38.302973 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:22:38.319702 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:22:38.321612 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:22:38.333540 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1452/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:22:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:22:44.969780 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=3 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:22:48.328447 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:23:56.824252 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:23:56.833963 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf003c-ae12-409b-8fee-4bf04c0f4575 None None] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:23:56.838414 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:23:56.839042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:23:56.839330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:23:56.839640 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:23:56.846862 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:23:56.848304 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:23:56.856264 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1437/2889] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:23:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:24:04.135984 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:04.148045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4a7b4-bd21-4a66-9236-7287a0fe3d70 service nova] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:04.152942 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:04.153565 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:04.153954 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:04.154244 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:04.163343 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:04.165063 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:04.175127 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1453/2890] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:24:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:24:06.852632 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:24:14.170787 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=6 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:24:32.120861 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:32.129567 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7c86-8dd8-4410-895c-9d144ff5166a service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:32.133213 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:32.133834 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:32.134121 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:32.134399 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:32.143638 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:32.145054 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:32.153743 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1438/2891] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:24:42.149744 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=6 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:24:45.461909 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:45.471957 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332554-02f9-4964-8f56-27e0daed732c service placement] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:45.475544 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7e8acb91804c358b40c90faa233296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:45.476169 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:45.476457 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:45.476737 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:45.545087 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:45.546483 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:45.564690 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1454/2892] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:24:48.540702 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:48.542133 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:24:48.557148 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e26e-aa46-4570-b66f-17cb50cc36cd service neutron] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:48.562010 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:48.562641 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] REQUEST_METHOD: `GET` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:48.563034 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:48.563319 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:48.565074 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:24:48.577683 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:48.579387 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:48.596487 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1439/2893] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:24:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 06:24:51.421050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:51.432422 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf8e4-84d1-4d22-99ad-9350d35c527f service neutron] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:51.437188 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:51.438037 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:51.438315 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:51.438591 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] PATH_INFO: `/v3/users/e72d1f42979b44bf9b8bf5d33b09685e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:51.439789 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72d1f42979b44bf9b8bf5d33b09685e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:51.441699 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:51.486654 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72d1f42979b44bf9b8bf5d33b09685e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.487305 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72d1f42979b44bf9b8bf5d33b09685e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.487933 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72d1f42979b44bf9b8bf5d33b09685e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.495200 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72d1f42979b44bf9b8bf5d33b09685e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.507213 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72d1f42979b44bf9b8bf5d33b09685e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.519797 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1455/2894] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:24:51 2022] DELETE /identity/v3/users/e72d1f42979b44bf9b8bf5d33b09685e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:24:51.691298 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:51.702607 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0143b-abb4-45be-8df7-198b4c8219ef service placement] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:51.758620 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:51.760008 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:51.760288 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:51.760562 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] PATH_INFO: `/v3/projects/064014a25c0e4e0da3b289cb3ea802e0` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:51.761727 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064014a25c0e4e0da3b289cb3ea802e0)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:51.763660 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:51.807948 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064014a25c0e4e0da3b289cb3ea802e0', 'request_id': 'req-d19933a7-bbad-465c-80bf-f85db48247d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.813908 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064014a25c0e4e0da3b289cb3ea802e0', 'request_id': 'req-d19933a7-bbad-465c-80bf-f85db48247d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.819370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064014a25c0e4e0da3b289cb3ea802e0', 'request_id': 'req-d19933a7-bbad-465c-80bf-f85db48247d6'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.847341 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] The token cache is being invalidate because project 064014a25c0e4e0da3b289cb3ea802e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:24:51.847672 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.848292 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.849826 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1440/2895] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:24:51 2022] DELETE /identity/v3/projects/064014a25c0e4e0da3b289cb3ea802e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:24:51.853756 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:51.855176 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:24:51.867921 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c96b-d0b8-4fbd-806d-f20fe8dc562f admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:51.911300 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:24:51.924445 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:51.925291 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:51.925576 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:51.925849 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] PATH_INFO: `/v3/users/57164119e34a433d91b0c594f2ec217e` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:51.927039 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57164119e34a433d91b0c594f2ec217e)` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:51.929008 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:51.973587 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57164119e34a433d91b0c594f2ec217e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.974232 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57164119e34a433d91b0c594f2ec217e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.974824 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57164119e34a433d91b0c594f2ec217e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.981721 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57164119e34a433d91b0c594f2ec217e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:51.993637 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.notifications [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57164119e34a433d91b0c594f2ec217e'} {{(pid=79994) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.005580 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1456/2896] 10.222.0.13 () {58 vars in 1223 bytes} [Wed Jun 22 06:24:51 2022] DELETE /identity/v3/users/57164119e34a433d91b0c594f2ec217e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:24:52.172634 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Authenticating user token {{(pid=79995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:24:52.174042 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.fernet_utils [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:24:52.187282 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19933a7-bbad-465c-80bf-f85db48247d6 admin admin] Validating token access rules against request {{(pid=79995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:24:52.248933 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201066f4889b4d3489fddb5528338862', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72d8da337ee49b5b2420009a5f9bd45', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:24:52.249774 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:24:52.250055 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] SCRIPT_NAME: `/identity` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:24:52.250330 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] PATH_INFO: `/v3/projects/519e4c6c8b34485b9811ab28d01b1be3` {{(pid=79995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:24:52.251521 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] RBAC: Authorizing `identity:delete_project(project_id=519e4c6c8b34485b9811ab28d01b1be3)` {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:24:52.253420 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] RBAC: Authorization granted {{(pid=79995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:24:52.261072 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:24:52.302788 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519e4c6c8b34485b9811ab28d01b1be3', 'request_id': 'req-77193107-501b-42cc-ab57-9672e6de256e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.309962 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519e4c6c8b34485b9811ab28d01b1be3', 'request_id': 'req-77193107-501b-42cc-ab57-9672e6de256e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.315750 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519e4c6c8b34485b9811ab28d01b1be3', 'request_id': 'req-77193107-501b-42cc-ab57-9672e6de256e'} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.327857 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] The token cache is being invalidate because project 519e4c6c8b34485b9811ab28d01b1be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 06:24:52.328155 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.328781 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG keystone.notifications [None req-77193107-501b-42cc-ab57-9672e6de256e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 06:24:52.330370 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: [pid: 79995|app: 0|req: 1441/2897] 10.222.0.13 () {58 vars in 1232 bytes} [Wed Jun 22 06:24:52 2022] DELETE /identity/v3/projects/519e4c6c8b34485b9811ab28d01b1be3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 06:25:02.001919 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:25:02.324746 dv-cinder-836996-37-iscsi devstack@keystone.service[79995]: DEBUG dbcounter [-] [79995] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=79995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 06:29:09.083859 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Authenticating user token {{(pid=79994) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 06:29:09.085239 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:29:09.223143 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b9f04-4340-4e56-aed9-bb57a792bba8 admin admin] Validating token access rules against request {{(pid=79994) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 06:29:09.286050 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90fb8c894b484ab1b739d5e8e6dec3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e576abf81756447c87069069c29d7003', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79994) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 06:29:09.286688 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] REQUEST_METHOD: `GET` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 06:29:09.286969 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] SCRIPT_NAME: `/identity` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 06:29:09.287247 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79994) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 06:29:09.289045 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.fernet_utils [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79994) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 06:29:09.300100 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 06:29:09.301672 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b315-43d4-461e-9f52-682b998f0166 service placement] RBAC: Authorization granted {{(pid=79994) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 06:29:09.311827 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: [pid: 79994|app: 0|req: 1457/2898] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Jun 22 06:29:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 06:29:19.307114 dv-cinder-836996-37-iscsi devstack@keystone.service[79994]: DEBUG dbcounter [-] [79994] Writing DB stats keystone:SELECT=89 {{(pid=79994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}